Computer aided routing system

ABSTRACT

A computer aided routing system (CARS) determines a travel route between a user selected travel origin and travel destination following user selected waypoints along the way. A CARS database incorporates travel information selected from a range of multimedia sources about the transportation routes, waypoints, and geographically locatable points of interest (POIs) selected by the user along the travel route. The CARS software permits user selection of specified POI types within a user defined region of interest and user selection of particular POIs from the selected types within the region of interest. The transportation routes, waypoints, POIs and region of interest are identified in the computer by coordinate locations of a selected geographical coordinate system. The CARS software is constructed to present a user customized travelog for preview on the computer display of the user defined travel route. The travel planner can preview on the computer display a multimedia travelog particularly customized for the user defined travel route including multimedia information on the transportation routes, waypoints, and POIs selected by the user. The user can engage in an iterative trip planning process of revising the route and previewing travelogs of revised travel routes until a satisfactory travel route is determined.

CROSS REFERENCE TO RELATED PATENT APPLICATION

This patent application is a continuation-in-part (CIP) of the David M.DeLorme et al U.S. patent application Ser. No. 08/265,327 filed Jun. 24,1994 for COMPUTER AIDED MAP LOCATION SYSTEM and the contents of thisrelated patent application are incorporated herein by reference.

TECHNICAL FIELD

This invention relates to a new computer aided routing system (CARS) forbusiness and recreational travel planning. The invention provides aninteractive computer travel planning guide for determining a routebetween a user selected travel origin and travel destination followinguser selected intermediate waypoints along the way. CARS softwaredetermines the preferred travel route within user selected constraints.The user can also select among a plurality of types of geographicallylocatable points of interest (POIs) within a user defined region ofinterest along the travel route. A CARS database incorporates travelinformation such as graphics, photos, videos, animations, audio and textinformation about the user selectable POIs along the way as well asabout transportation routes and waypoints. From the user selected anduser defined transportation routes, waypoints, and POIs along the travelroute, the CARS software constructs a user customized multimediatravelog for preview on a computer display of the user defined travelroute. Based on the user customized previews, the travel route includingtransportation routes, waypoints, and points of interest can be updatedor changed according to the user preferences and choices. Modifiedtravel routes can be previewed with further multimedia travelogs until asatisfactory travel route is achieved.

BACKGROUND ART

A variety of computer hardware and software travel planning aids arecurrently available on the market primarily for vacation andrecreational travel planning. A number of the travel guide softwarepackages focus on National Parks of the United States or recreationaltours and activities with prepared travelogs or prepared assemblages ofmultimedia travel information on the different recreational geographicallocations or recreational activities. Such travel software programs areexemplified for example by the America NavigaTour ™ MediAlive ™multimedia travel guide produced by CD Technology, Inc.; the GreatVacations ™ Family Travel Guide by Positive Software Solutions; theAdventures ™ CDROM Program for worldwide adventure travel by Deep RiverPublishing, Inc.; and National Parks of America, a CDROM product ofMulticom Publishing, Inc. which contains a directory of all NationalParks in the United States.

Rand McNally produces a software travel planning product under thetrademark TRIPMAKER ™ for planning a trip by car in the United States,Canada, and Mexico. The Rand McNally Tripmaker ™ software alsocalculates quickest, shortest, and preferred scenic routes for the tripplanner. While the Rand McNally product incorporates a database of manypoints of interest, the multimedia travelog information appears limitedto preplanned scenic tours.

Similarly the American Automobile Association in cooperation withCompton's NewMedia also provides travel planning from starting point todestination point with stopping points in between. The CDROM productcontains a database of travel information. However the multimediainformation available from the database appears limited to "suggestedroutes of travel" again limiting user choice.

In each case it appears that travel information from multimedia sourcesis preassembled by editors so that the user or trip planner is limitedto "canned" or prepared multimedia travelogs of prescribed, suggested,or preplanned tours. Or the user is limited to information fragmentsabout this or that particular object of interest or this or thatparticular place. There is no opportunity or user capability andselectivity in constructing a user customized travelog of assembledmultimedia information for previewing a particular user determined routeof travel. The user is relegated to travelogs and multimedia assemblagesprepared for routes and tours proposed by other editors.

OBJECTS OF THE INVENTION

It is therefore an object of the present invention to provide a newcomputer aided routing system (CARS) capable of determining a travelroute between a user selected travel origin and travel destinationfollowing user selected waypoints of interest along the way. A featureof the invention is that the user can construct a highly selectivetravel route incorporating waypoints selected by the user.

Another object of the invention is to provide a database ofgeographically locatable objects or points of interest (POIs) organizedinto a plurality of types for selection by the user. The database alsoincorporates travel information selected from a range of multimediasources about the transportation routes, waypoints, and geographicallylocatable objects of interest along the travel route. A feature of theinvention is that the objects of interest are encompassed within a userdefined region of interest of user specified dimensions along the travelroute.

A further object of the invention is to provide CARS software capable ofpresenting a user customized travelog or sequential assemblage ofmultimedia information for preview on the computer display about theuser defined travel route. The travelog includes multimedia informationabout the transportation route, waypoints, and selected POIs in the userdefined region of interest along the travel route.

A feature of the invention is that the trip planner is no longerrelegated to the prescribed or suggested routes and tours of othereditors for previewing travel routes. Nor is the trip planner limited toadhoc or fragmented multimedia information about this or that object ofinterest. Rather, the user constructs a user defined travel routeincluding transportation routes, waypoints, and POIs within a region ofinterest along the travel route. The CARS software responds byassembling a user customized travelog or sequential assemblage ofmultimedia information for previewing the entire trip. The travel routeincluding transportation routes, waypoints, and objects or points ofinterest can then be changed if necessary to suit the user preferencesand choices.

An advantage of the invention is that travel planning can be optimizedin an iterative process. The user constructs a travel route and at thesame time the user constructs a customized travelog for previewing theinitial travel route. On the basis of the multimedia preview of theinitial travel route the trip planner undertakes revision of the travelroute, e.g. by changes in the selected transportation routes, waypoints,and selected POIs. The travel route is recalculated by the CARS softwareand the user customized travelog is also reconstructed for furtherpreview. Further refinements can follow in subsequent iterations until asatisfactory travel route is achieved.

DISCLOSURE OF THE INVENTION

In order to accomplish these results the present invention provides acomputer aided routing system (CARS) for use with a digital computer anddigital computer display. A variety of other peripheral equipment isalso provided as hereafter described. A set of electronic maps isprovided for presentation on the computer display. The electronic mapsdepict transportation routes having route intersections and identifiedwaypoints at geographical locations along the transportation routes. Theroute intersections and identified waypoints depicted on the electronicmaps are identified in the computer by coordinate locations of aselected geographical coordinate system.

A CARS database contains geographically locatable objects (loc/objects)also referred to as points of interest (POIs) identified by coordinatelocations in the geographical coordinate system. The POIs are organizedinto a plurality of types for user selection of loc/objects or POIsindividually and by type. The loc/object or POI types constituteelectronic overlays of the database for display over the electronic mapson the computer display. As used in this specification and claims, thephrase points of interest or POI's is generally used to refer toloc/objects for which multimedia information is available for describingthe POI's and presenting the points of interest in a multimedia travelogas hereafter described.

Typically, the CARS database is a geographical information system orGIS. Such a GIS manages data in the GIS database in relation to thegeographical coordinate locations of the selected geographicalcoordinate system. Thus, the CARS database manager relates points ofinterest and any other loc/objects of the database with particularlocations on or near the surface of the earth in terms of coordinatelocations such as latitude and longitude. The multimedia informationhereafter described is similarly identified with the coordinate locationof the subject POIs.

The computer aided routing system incorporates CARS software constructedfor user travel planning using the electronic maps presented on thecomputer display. The CARS software permits user selection of a travelorigin, travel destination, and desired waypoints between the travelorigin and travel destination. The CARS software calculates, delineatesand displays a travel route between the travel origin and the traveldestination via the selected waypoints. The travel route is calculatedaccording to user choice of the shortest travel route, quickest travelroute, or user determined preferred travel route. As used in thespecification and claims, waypoints refers to the origin and destinationof a possible route and intermediate points or places along the wayincluding major road and highway intersections, joints or turning pointsat connected short line segments of major roads and highways, placenames situated on major roads and highways, and as hereafter described,POIs near the major roads and highways.

The CARS software permits user selection of an area or region ofinterest along the user defined travel route. The area or region ofinterest is defined by user specified dimensions and may be for examplea corridor of specified width along the travel route, circles ofspecified diameter at locations along the travel route, or regular andirregular polygons, etc. The CARS software permits user selection ofspecified POI types within the user defined region of interest and userselection of particular POIs from the selected types within the regionof interest. The region of interest is identified in the computer bycoordinate locations of the geographical coordinate system.

The CARS database also incorporates travel information about the POIsidentified in the database and about selected transportation routes andwaypoints of the electronic maps. The travel information may be from avariety of multimedia sources and is for example selected from the groupconsisting of graphics, photos, videos, animations, audio and textinformation, etc. As hereafter described the multimedia travelinformation is subject to a high degree of user selectivity in composingcustomized multimedia travel information packages.

The CARS software is also constructed to present a user customizedtravelog for preview on the computer display of the user defined travelroute. Thus multimedia travel information is assembled from the CARSdatabase on the transportation routes and waypoints of the electronicmaps and the selected POIs of the database in the user defined region ofinterest along the travel route.

A feature and advantage of the computer aided routing system is that thetravel planner can preview on the computer display a travelogparticularly customized for the user defined travel route includingmultimedia information on the transportation routes, waypoints, and POIsselected by the user. The trip planner is not constrained to viewing"canned" or preselected multimedia assemblages and travelogs forsuggested routes planned by other editors. Rather the CARS systemdelivers a user customized travelog or multimedia information assemblagedirected specifically to the user defined travel route including theuser selected transportation routes, waypoints and POIs.

As a result of this preview, the trip planner can revise the travelroute including transportation routes, waypoints, and POIs. The CARSsoftware then recalculates the travel route affording furtheropportunity for selecting new or different POIs in the newly definedregion of interest along the new travel route. A new multimedia travelogpreview is assembled corresponding to the new travel route and theprocess is repeated until the user achieves a satisfactory travel routebased on the iterative trip planning process and multimedia previewsmade available by the invention.

A feature of the invention is that one or more points of interest in theuser defined region of interest along a travel route can be converted bythe user to waypoints on a new travel route. The POI status thereforechanges from a possible side excursion off the main travel route to anactual waypoint on the new or revised travel route. The user thereforehas available a wide selection of possible sites for defining a travelroute including route intersections, named places on the electronic map,and the array of geographically locatable objects about which there ismultimedia information and therefore referred to as points of interestof the CARS database.

In the preferred example the CARS software is constructed to display auser customized strip map of the user defined travel route. The usercustomized strip map is typically displayed along the center of thecomputer display. User selected POIs in the user defined region ofinterest are listed along one side of the strip map with pointers torespective POI locations in the region of interest. Travel directionsfor the travel route are listed along the other side of the strip mapwith pointers to respective intersections corresponding to directionsalong the travel route.

Preferably the strip map is vertically oriented with the travel originat the bottom of the strip map and travel destination toward the top ofthe strip map. An advantage of this arrangement is that the strip mapand travel route are always oriented in the direction of travel and theright and left directions coincide with actual right and leftdirections.

In the preferred example the digital computer also incorporates aprinter and the CARS software is constructed for printing hardcopy mapsof the user customized strip maps. The hardcopy maps of the usercustomized strip maps show the travel route, list of POIs and pointersalong one side of the strip map, and list of directions and pointersalong the other side of the strip map. The printed hardcopy map ispreferably vertically oriented also with the travel origin at the bottomof the strip map and travel destination toward the top of the strip map.

The electronic maps, CARS database, and CARS software are typicallystored on a CDROM and the digital computer incorporates a CDROM drive.The CARS software may include a replace function for updating theelectronic maps and CARS database on the CDROM with replacement orsupplemental information from another memory device.

The CARS system works with a geographic information system or GISmanaging data in relation to specific geographic coordinates. The GISenables display of electronic maps which function as a user interface aswell as a system for display of geographic data. The GIS and the mappinginterface coordinate two broad types of data: (1) transportation routesor networks and nodes or waypoints subject to routing computations; and(2) POIs or loc/objects related to information about travel andlocations in various media.

Transportation routes depicted on the electronic maps may include allforms of transportation routes for example selected from the groupconsisting of vehicle routes, ferry routes, air travel routes, bicycleroutes, and hiking trails. Such routes are typically represented as linesegments, vectors or networks appropriate to the modes of transportationinvolved. The GIS and the user manage and manipulate such routing datain terms of geographic points including intersections, terminals,junctions and connections, generally labelled "nodes". Particular travelplans or itineraries along available transportation routes entailspecific selections and arrangements of nodes called "waypoints". Usersenter or list waypoints in the order of an intended journey including apoint of departure, optionally intermediate stops or places to passthrough on the journey, plus a final destination. In summary, nodescomprise the possible waypoints from which the user composes specificwaypoint lists or input for routing.

Nodes and waypoints for routing, as well as POIs associated withmultimedia information, are all related in the GIS database togeographical coordinates corresponding to particular locations on oradjacent to the earth's surface. The selected geographic coordinatesystem may be for example the latitude/longitude (lat/long) geographicalcoordinate system. Coordinate locations which correspond to specificnodes, waypoints or POIs are then stored in the digital computer aslat/long coordinates. In some cases, POIs and nodes coincide or share aparticular location or set of geographic coordinates. POIs relate tomultimedia information on locations, however, while nodes and waypointsrelate to routing.

The CARS system permits the user to locate, click on or otherwise choosesuch nodes or possible waypoints and POIs in order to develop his or herindividual travel plan. The CARS software is also constructed forincorporating POIs selected by the user, while playing relatedmultimedia in the region of interest, as new waypoints in the userdefined travel route. The CARS software can then recalculate, delineateand display a new user defined travel route via the selected loc/objectsor points of interest treated as added waypoints. The CARS database orGIS also stores information about the transportation routes entering andleaving the respective waypoints as well as the identity of immediatelyadjacent nodes.

According to the invention POI types of the CARS database may beselected for example from the group consisting of restaurants,hotels/motels, cities, municipalities, settlements, routes,transportation services such as airports, ferries, and railroads, parks,recreation areas, campgrounds, hospitals, zoos, museums, tourist andsightseeing attractions, other geographical landmarks, etc. In asimplified example, the POI types can be limited to hotels, campgrounds,restaurants, and selected tourist attractions.

Data items of the various types of POIs are stored, managed andmanipulated within the CARS database or GIS in relation to one or moremedia from the group of alphanumeric text, still or moving graphics andaudio including voice, natural and artificial sound. For an example, atypical hotel POI item includes information of interest to travelersabout the accommodations, room prices, other facilities and nearbyrecreational and cultural attractions in a variety of selectable text,audio and pictorial media.

The invention also provides a set of printed maps substantiallycoinciding with the set of electronic maps for user cross reference,correlation and coordination between the computer display presentedelectronic maps and the printed maps. A grid system of grid linesoverlays the electronic maps and the printed maps. The grid lines defineuniquely named grid quadrangles. The uniquely named grid quadrangles ofthe electronic maps and printed maps substantially coincide ingeographic areas depicted by the grid quadrangles to facilitate crossreference, correlation and coordination between the computer display mappresentations and the corresponding printed maps, as set forth infurther detail in the related patent application cross referenced above.

The electronic maps and printed maps are constructed to be substantiallyconstant scale maps. The electronic maps may be at a plurality ofscales, each scale level incorporating substantially constant scalemaps. In that case the grid system also incorporates a plurality of setsof grid lines corresponding to the respective scales and defininguniquely named grid quadrangles at each scale. The CARS software isconstructed to permit user scrolling across grid quadrangles at the samescale and to permit zooming between grid quadrangles at differentscales. The scrolling and zooming steps are displayed on the computerdisplay. Further details on the scrolling and zooming capabilities ofthe mapping database manager are set forth in the David M. DeLorme U.S.Pat. No. 4,927,319 issued Nov. 20, 1990 for ELECTRONIC GLOBAL MAPGENERATING SYSTEM and the David M. DeLorme U.S. Pat. No. 5,030,117issued Jul. 9, 1991 for DIGITAL GLOBAL MAP GENERATING SYSTEM. Thedigital computer may be selected from a range of hardware eitherportable or stationary including PDA's, notebooks, portable computers,desktop computers, workstations, and mainframes.

Generally the CARS software of the invention is constructed so that thetrip planner can easily change any of the user selected parameters suchas user selected travel origin, travel destination, transportationroutes, and waypoints. POI's can also be incorporated as waypoints alongthe route. The CARS software recalculates, delineates, and displays onthe computer display the revised travel route. It also assembles anddisplays a revised user customized multimedia travelog for previewingthe revised travel route. These steps can be repeated in an iterativetrip planning process until the user arrives at a satisfactory userdefined travel route.

In the preferred example, the CARS software is composed of a routingsubsystem, a multimedia subsystem, and an interactive mode forinteraction between the two subsystems. The routing subsystem performsthe travel planning and routing functions, calculating and displaying aroute according to user specified choices and constrains. The multimediasubsystem performs multimedia functions, retrieving and displayingmultimedia information about selected PDI's. In the interactive mode,the multimedia subsystem constructs a travelog following the userdefined route calculated by the routing subsystem.

The invention also provides a new computer aided routing method (CARM)using a digital computer with computer display and electronic maps. Asnoted above, the electronic maps include transportation routes, routeintersections and identified waypoints along the transportation routes.The method also uses CARS software for user travel planning.

The method steps of the invention include presenting the electronic mapson the computer display; selecting waypoints by using the electronicmaps, or by list-based sources for locating by place names, zip codes ortelephone exchange data etc., or by responding to related multimediaabout proximate points of interest. The waypoints include a user travelorigin and travel destination, and intermediate waypoints of interest atgeographical locations between the travel origin and travel destination.The method steps further include calculating, delineating, anddisplaying on the computer display a travel route between the usertravel origin and travel destination via the user selected waypoints ofinterest according to user choice of the shortest travel route, quickesttravel route, or user selected preferred travel route.

The method proceeds by selecting a region of interest to the user alongthe user defined travel route, and defining the region of interest byuser defined dimensions limiting excursions on either side of the userdefined travel route. The method uses a database of geographicallylocatable points of interest in the geographical areas of the electronicmaps. The POIs are organized into a plurality of types for userselection of POIs by type. The POI types provide overlays of the CARSdatabase for display over the electronic maps on the computer display.The database also includes the travel information selected from thegroup consisting of graphics, photos, videos, animations, audioinformation and text information about transportation routes andwaypoints of the electronic maps and points of interest of the CARSdatabase.

According to the method, further steps include identifying in thedigital computer the transportation routes, route intersections, andwaypoints of the electronic maps, corridor of interest selected by theuser, and the POIs of the first database, by coordinate locations in acommon geographical coordinate system; selecting specified POI types inthe user defined corridor of interest along the user defined travelroute and selecting particular points of interest from the selectedtypes in the corridor; and assembling and displaying on the computerdisplay a user customized travelog for preview of the user definedtravel route, said travelog including travel information in the databaseon the transportation routes and waypoints of the electronic maps andselected POIs in the user defined corridor of interest along the userdefined travel route.

The invention also contemplates steps of changing the user selectedtravel origin, travel destination, transportation routes, orintermediate waypoints; recalculating, delineating, and displaying onthe computer display a revised travel route; and assembling anddisplaying on the computer display a revised user customized travelogfor previewing the revised travel route.

According to another feature of the system and method, points ofinterest selected by the user within the user defined region of interestalong a user determined travel route can be converted to waypoints. Thetravel route is then modified to incorporate the selected points ofinterest as actual waypoints in a new or revised travel route. Theselected POIs then have a new status in the proposed travel plan. Ratherthan merely possible destinations reached by side excursions from thedesignated travel route, they actually become waypoints on the travelroute. The routing algorithm or routing procedure of the CARS softwaretherefore determines the shortest route, quickest route, or user definedpreferred route through the selected POIs as waypoints on the travelroute.

An advantage of the computer aided routing system is the availability ofan array of multimedia information for points of interest and places inan area of interest. A user can therefore initially browse through theavailable information before even attempting an initial route. The arrayof multimedia information can then provide a basis for selecting aninitial route with destination and waypoints. Once establishing aninitial route the user can then follow the interactive and iterativeprocedures of the computer aided routing system.

Other features of the system and method are set forth in further detailin the following specification and accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is a diagrammatic perspective view of an operating system andsystem user showing the computer aided routing system according to thepresent invention.

FIGS. 1B-1M, 1O and 1P illustrate example screen displays and userinterfaces for the computer aided routing system while FIG. 1Nillustrates an example hard copy printout of a travel plan prepared bythe computer aided routing system.

FIG. 2 is an overall block diagram of the interactive CARS systemcombining routing and travel operations with multimedia informationoperations.

FIG. 3 is a flow chart showing the operational steps and user optionsavailable to multimedia users of the CARS system.

FIGS. 4A,4B, and 4C are assembled to form a flow chart showing theoperational steps and user options available to travel planning androuting users of the CARS system. The flow chart assembled by FIGS.4A,4B, and 4C is referred to in the specification as FIG. 4.

FIG. 5 is an example of a map display presented to the user on a monitordisplay by the CARS system.

FIGS. 5A,5B and 5C are simplified screen displays showing alternativestrategies and methodologies for circumscribing points of interestwithin respective defined areas of a selected travel route.

FIGS. 6A and 6B are assembled to form a flow chart showing theoperational steps of the CARS system for transforming a routing waypointlist or list of nodes of a selected route into a list of points ofinterest within defined areas along the selected route.

FIGS. 7A,7B, and 7C are assembled to form the flow chart referred to inthe specification as FIG. 7 showing the user controls and commands madeavailable to the multimedia user of the CARS system.

FIGS. 8A-8E further illustrate the flexible user controls and commandsfor multimedia related operations of the CARS system.

DESCRIPTION OF PREFERRED EXAMPLE EMBODIMENTS AND BEST MODE OF THEINVENTION

A computer aided routing system (CARS) 100 according to the presentinvention is illustrated by way of example in FIG. 1A. A user 103operates the software system 100, provided on CD-ROM, utilizing adesktop personal computer equipped for multimedia. In the preferredembodiment, illustrated in FIG. 1A, the personal computer system 105comprises a 286, 386 or 486 Intel processor or equivalent, with typicalmemory devices, associated circuitry and peripheral devices including amonitor or CRT 117, a speaker or audio system 107, a printer 125, aCD-ROM player 112, a mouse 115 and keyboard 110. Alternatively, thesoftware system 100 can be provided on diskette, run from a hard driveor central server.

Alternative embodiments could include other input devices e.g. voicerecognition system, joystick, touch-screen, scanner for printed mapinput, simplified keypad, etc., not represented here. FIG. 1A disclosesthe CARS computer aided routing system 100 implemented on a single,stand-alone, desktop style, personal computer. The software technology,which facilitates interactivity between routing and multimedia, alsoworks on a more portable laptop or notebook computer, a handheldpersonal digital assistant (PDA), embedded in a travel planningappliance or an in-vehicle navigation system, as well as on mainframesof various kinds, distributed work stations, or networked systems.Alternatively, users can also operate the CARS computer aided routingsystem 100 from a remote interface through wireless or hard-wire linksconnecting with a distant computer system or a central service bureau.

FIG. 1A shows a map book or set of printed maps typically on paper media128 corresponding to the electronic or digital map 122 displayed on thescreen or monitor 117. The printed maps 128 can be consulted as an aidin using the corresponding electronic or digital maps 122 displayed onscreen, and the hardcopy travel plan printouts 126 derived frominteractivity between the routing and multimedia elements of theinvention. It is expected that users will printout such hardcopy travelplans 126 to guide and direct their journeys on foot, in vehicles, or byother means of travel.

The hardcopy travel plan 126 illustrated in FIG. 1A consists of a stripmap noting points of interest, travel directions and critical turningpoints along the recommended route, described in more detail hereafter.Such hardcopy travel plans, typically printed on paper, comprise aportable and compact form of output from the system, useful and easilyread in field situations, without the expense or burden of carrying evena small computer device. A variety of other forms of digital and printedmedia output can result from the combination of the software routing andmultimedia processes, as described hereafter.

The user 103, in FIG. 1A, is operating both the routing and relatedmultimedia elements of the invention. The monitor 117 screen is filledwith an electronic or digital map display 122 on which departure points,destinations and other waypoints can be entered or deleted and theshortest, fastest or otherwise optimized routes calculated, as describedin more detail below. At the same time, in a multimedia window 120superimposed upon the map display, the user 103 is engaged in viewing,hearing, or responding to a selectable, multimedia presentation relatedto points of interest and locations displayed on the underlying mapscreen 122.

For purposes of the this specification the term multimedia embraces allmanner of graphics, text, alphanumeric data, video, moving or animatedimages, as well as still images, photographs and other audio or visualinformation in digital or analog formats. Multimedia also includes audiooutput options, voice, music, natural and artificial sound, conveyed tousers through a speaker system 107 or earphones 108. As detailedhereafter, the invention stores, manages and retrieves a database ofmultimedia information in relation to specific places on or near thesurface of the earth, referred to herein as points of interest (POIs),or geographical sites or locations. These are geographically locatableobjects (loc/objects) for which multimedia information is available inthe CARS database. Generally, POI's can be represented in both digitaland print media cartography and are situated or described by standardgeographic coordinates such as latitude and longitude, UTM, State Plane,or equivalent map location systems.

From the digital map and routing function shown in FIG. 1A at 122, theuser 103 can select one or more particular geographic locations, orpoints of interest (POIs), in order to view, hear or manipulate relatedinformation in the multimedia dimension of the invention. FIG. 1A showsthe multimedia element of the invention as an episode in a multimediapresentation comprised of graphics or text, shown in an on screen window120, or audio output conveyed to the user 103 via a speaker 107 orearphones 108. For example, in the multimedia window 120, the user 103can view and selectively respond to color photographic or video imagesor related textual information about a specific location, or group oflocations. Locations are chosen by the user working within theunderlying digital map and routing dimension of invention, illustratedat 122. More specifically, FIG. 1A shows a scenario in which the user103 has selected a particular lakeside location 124 on the underlyingdigital map, or in conjunction with a route or a waypoint along a route.The specific lakeside location 124 is shown as an X in a circle 124 onthe simplified drawing of a typical digital map screen 122. The user 103picked this point of interest located by a lake by means such as a mouseclicking operation at the location or placename as depicted on thedigital map 122. The location can also be identified by words or symbolsalong a displayed route on the underlying digital map screen 122, byselection from a list of place names or from a list of types oflocations, or by other routine or state of the art inputs.

The user's choice of a particular location prompts a multimediapresentation 120 of information related to the selected place e.g.stills or video pictures of the lake, local events, places to stay oreat, attractions and recreational opportunities, related text or audionarrative, local history, lore, even complex or extensive data ontopographic, environmental, demographic, real estate or marketinginformation, etc. The multimedia presentation is illustrated by thegraphic image of a view of the lake, sailboat and mountains on the farshore, in the window 120, accompanied by related audio output 107 or108. The CARS system 100 enables a user to prompt a multimediapresentation 120 on a location 124, or group of locations, selected fromwithin a digital or electronic mapping system 122, equipped to dorouting functions and displays 123.

FIG. 1A additionally illustrates procedures whereby users can modifywaypoints, and other route parameters, from within the multimediaelement of the software invention. Typically, routes or waypoints aredisplayed as highlighted line segments or points 123 on the digital orelectronic map 122. Routes and waypoints may also take the form of mapsymbols and annotations, or of ordered lists of place names, traveldirections, geographic coordinates or various other locationidentifiers, as described hereinafter. The CARS system 100 combinesrouting and multimedia elements by enabling the user 103, to add, deleteor insert one or more particular geographic locations or points ofinterest. This is achieved based upon the presentation of multimediainformation about those locations, as new or modified input foradditional processing of the route.

For example, in FIG. 1A, mouse manipulable buttons along the bottom ofthe multimedia window 120 enable the user 103 to command the CARS system100 to include the lakeside location 124, based on the multimediapresentation 120, as new input for routing. The CARS system 100facilitates entry or deletion of locations, reviewed in multimediasubject matter, as new starting places, destinations, intermediatewaypoints, or points of interest along the way as part of the userselected route. FIG. 1A represents how user interactions with multimediaabout locations can be used to change the route.

FIG. 1A further illustrates output from the CARS system 100, a hardcopyprintout 126, typically a customized or individualized travel plan inthe shape of a strip map annotated with travel directions and relatedinformation. Output from the CARS system 100 is produced by combinedinteraction between the routing functions and user responses to themultimedia information about particular geographic locations. Thus, forone example, the hardcopy travel plan 126 exhibits attached points ofinterest, typically in the form of annotations connected with graphicarrows or pointers to particular geographic locations which fall withina predetermined distance from a displayed route. The user attaches suchpoints of interest to a digital map route display from a multimediapresentation on those locations. Alternative forms of digital, audio,text, graphical, hardcopy or multimedia output from the CARS system 100are detailed later in this disclosure.

Output from the invention can result from a single, simple interactionbetween routing and multimedia elements. FIG. 1A illustrates a scenariowhereby the user selected only one point of interest, a place by a lake124, close to a route 123 highlighted upon an electronic or digital mapdisplay 122. Next the user prompted the presentation of multimediainformation in a window 120 concerning the lakeside point of interest.Intrigued by the multimedia presentation, the user then pushed the"Attach" button in the command bar across the window bottom, orotherwise prompted the CARS system to include the lakeside location asan annotated point of interest within a specified distance from thehighlighted route displayed upon the map screen or printed on a hardcopytravel plan.

In FIG. 1A, the hardcopy travel plan 126 output actually contains arrowsor pointers from three annotation boxes to three corresponding points ofinterest attached to the strip route map output. Moreover, thehighlighted route running up the center of the strip map format mayreflect waypoints added or deleted over the course of a sequence ofinteractions between the multimedia and routing elements of theinvention. Users can utilize the invention to attach multiple points ofinterest, or make many modifications of actual waypoints and highlightedroutes, working interactively between the multimedia database and therouting function. The system, as described hereafter, is flexible,selective and capable of series of multiple interactions and repeatediterations in order for the user to develop, alter and refine anindividualized or customized travel plan through varied operationalcycles, combining routing and utilization of the multimedia database onlocations.

FIG. 1A therefore illustrates but one episode in a potential series ofinteractions between the routing and multimedia sides of the system, forproducing a customized travel plan output, as exemplified by theannotated hardcopy travel plan 126 and further detailed in FIG. 1N. Sucha travel plan, and alternative forms of output can result from attachingmultiple points of interest, waypoints, and route modifications basedupon a succession of multimedia presentations of information on manylocations to generate a custom travel plan tailored to the user'spersonal preferences, as expressed throughout the whole sequence ofinteractions.

FIGS. 1B-1P

FIGS. 1B through 1P are screen captures from MAP`N`GO ™ 1.0 by DeLormeMapping, Freeport, Me. 04032. MAP`N`GO 1.0 includes an auto road atlasof North America both on CD-ROM and printed in a companion paper mapbook. The MAP`N`GO 1.0 CD-ROM contains a travel planning softwareutility embodiment of the present CARS invention. This utility enablesusers to generate digital or hardcopy travel plans from routingoperations and selected audio, text and pictorial information on hotels,restaurants, campgrounds and tourist attractions.

FIG. 1B reveals the basic user interface, including a map display, anddiverse user options for manipulating the electronic maps. Three buttonswith diagonal arrows in a row at 130 enable the user to zoom in or outamong map scales. Nine buttons in the form of a compass rose at 131cause the electronic map display to shift or pan to center on a newlatitude and longitude. At 134, an overview screen shows the areadepicted on the main map in a rectangle in relation to surroundinggeography. Mouse clicks in the rectangle further enable the user toshift or pan the center of the map to a different location on theearth's surface. Page numbers and grid identifiers are indicated at 132for coordinated use of companion paper maps. At 133, the main map scaleis shown in terms of "mag" or "magnitude" such that mag 10 offers acloser typically more detailed view than mag 8 or 6, which each presentincreasingly distant perspectives or map coverage of larger parts of theearth's surface.

FIG. 1C also reveals the basic user interface, including a highermagnitude or closer scale map, as shown at 135. Compared to FIG. 1B,FIG. 1C offers a main electronic map display with more detail includinggeometric symbols in small rectangles under "Seattle" for example. Thesesymbols represent the availability of supplemental travel information onspecific types of locations e.g. Hotels, Campgrounds, Restaurants andPoints of Interest. As disclosed hereafter, the user can access andmanipulate the added multimedia travel information by various mouse orkeyed commands.

FIGS. 1D, 1E and 1F illustrate assorted locating tools for findinggeographic locations, recentering the electronic maps, and selectingspecific places or geographic loci as input for routing or multimediaoperations. Three buttons in the row at 136 prompt the dialog boxes for"Locate Place Name" at 137, "Locate Zip Code" in FIG. 1E and "LocateArea Code and Exchange" in FIG. 1F. This suite of locating toolsfacilitates searching lists by the names of places or cities andrespective states or provinces as well as locating specified places byrecentering the map display upon the identified location.

FIGS. 1G, 1H, and 1I express the interface for routing and relatedoperations. The user can access the Manage Route menu or dialog box at138 by depressing the Route button at 140. A quick pull-down menu at 139also makes routing or related options available. The user can enter astarting place e.g. Montpelier, Vt. and a final destination e.g.Plattsburgh N.Y. plus intermediate, optional waypoints in between ifdesired. A suite of buttons at 141 enable the user to add, insert,delete, etc. items to or from the waypoint input list by routine textand graphic input means. Entered waypoints are symbolized on the mapinterface by numbered inverted triangles as shown at 147. The userprompts calculation of optimal routes by selecting between Quickest,Shortest or Preferred options at 143 or the 139 quick menu. Theresulting route is displayed by highlighting the recommended roads onthe map display as shown at 146 from Montpelier through Burlington toPlattsburgh. Added control over routing parameters or variables isprovided by depressing Speed 144 and Prefers 145 buttons which accessdialog boxes for adjusting the routing computation. The FIG. 1I dialogbox allows the user to modify estimated or anticipated speed, or rate oftravel, in miles or kilometers per hour for various roadclassifications. The FIG. 1H dialog box enables the user to calibratethe routing computation module to favor or avoid specified types ofroads.

FIGS. 1J and 1K further depict routing functionality plus introducemultimedia capabilities. Accessed for example through the 139 quick menuin FIG. 1G, the Points of Interest Along the Way dialog box at 148 inFIG. 1J exhibits a list of three items termed POIs for points ofinterest in this disclosure. By prompting the Along the Way command,after inputting an ordered list of waypoint input, the user has causedthe software to seek and find POIs within a specified distance from thecomputed route for which further information is available in the form ofaudio, pictures or text. By depressing either the Show/Tell All or theShow/Tell One buttons on the right in the 148 Along the Way dialog box,the user can prompt a multimedia presentation or series of presentationsas shown at 151 in FIG. 1K. Controls along the bottom of the 151 picturedisplay window on Burlington facilitate user control and selection ofmultimedia content and form, as described hereafter. In FIG. 1J, theAttach button on the right in the 148 dialog box enables the user topick, fix and include selections of information with travel plan output,as disclosed further hereafter. Travel Plan dialog or list boxes areshown at 149 in FIG. 1J and 152 in FIG. 1K. Travel Plan list boxes are aform of routing computation output including a list of waypoints,routes, compass directions, nearby town, time and distance estimates forroute segments and the overall route.

FIGS. 1L and 1M further depict information resources about specifictypes of places. As disclosed hereafter in relation to FIG. 1-0 andquick menu 161, the user can access information on specific types ofPOIs such as hotels or restaurants. List boxes for local hotels andrestaurants appear at 154 and 156 in FIG. 1L and for campgrounds at 158in FIG. 1M. These listboxes all have a button to Attach information onchosen accommodations to emerging travel plan output. These listboxesalso allow the user to call for more detailed information or Full Infoon selected locations of the respective types. Such informationavailability is indicated on the mapping interface by colored symbolswithin a small rectangle under or adjacent to the relevant place name,as shown for Shelburne at 157. The Campground information box at 159shows a typical display of Full Info requested by the user concerningthe Shelburne Camping Area.

FIG. 1N illustrates a typical, moderately complex MAP`N`GO ™ 1.0hardcopy travel plan output, as developed in FIGS. 1G, 1J and 1K. Notethe heading up orientation of the travel plan, with point of departureat the bottom and destination at the top of a strip map format, ascompared with the conventional North is Up and South is Down orientationof the map display in FIG. 1G. The heading up strip map format of theFIG. 1N travel plan has the advantage of a mapping representation inwhich a route change involving a righthand turn e.g. in Burlingtonappears intuitively as a righthand turn on the travel plan map. The FIG.1N travel plan illustrates text travel directions and travel timeestimates in hours and minutes along the right margin. Pictorial andtext attachments plus estimated miles of travel are presented in theleft margin and border of the FIG. 1N strip map.

FIGS. 1-0 and 1P illustrate advanced capabilities to do routing ormultimedia and combined operations. In the absence of any prior routinginput, the user can click on a location, like Seattle at 160, for whichmultimedia is available. The user can then select various operations ortypes of information from the quick menu at 161. Selection of Points ofInterest, for example, brings up a list box for tourist attractionssituated in Seattle as shown towards the bottom of the Points ofInterest window for Seattle at 162. As shown in the middle of the windowat 162, the user can scroll through text information concerning selectedattractions, such as the Museum of Flight. The user can prompt pictorialand audio information using the Show/Tell button at 164. The Show/Tellcommand results in a selectable audio or pictorial presentation at 165and 168 subject to a flexible set of user controls at 166.

As shown in FIG. 1P, flexible control over multimedia form and contentenables the user of an in-vehicle embodiment of the invention, forexample, to maintain an output of audio 169 travel directions for thedriver to hear. Meanwhile, the passenger can monitor the visual routemap at 170 and, at the same time, browse through information aboutplaces to eat in Seattle using the 171 Restaurant list box.

FIG. 2

FIG. 2 is a block diagram illustrating an interactive system 200 whichcombines computer software processes for routing and travel directionswith presentations of multimedia information related to locations.

The CARS system works with one or more geographic information systems(GIS) 201 for storage, retrieval, manipulation, mapping, correlation andcomputation of spatial data related to geographic coordinatescorresponding to locations on, above or beneath the surface of the earthwithin the realm of human activity. The David M. DeLorme U.S. Pat. Nos.4,972,319 and 5,030,117, exemplify such geographic information systemsfor generating the map displays and output, as well as management of thegeographic databases. Other GIS, or other database systems which relatedata with geographic coordinates e.g. latitude and longitude, alsosuffice for use with the present invention.

On the left, in FIG. 2, block 205 comprises the subsystem for routing.Block 209, on the far right, relates to one or more databases ofmultimedia information concerning places or objects identified bygeographic coordinates. In the middle, block 207 illustrates the datatransfer processes and operational pathways facilitating interactivity,or combined operations, between the multimedia 209 and routing 205subsystems.

Processing starts either with routing 203 or multimedia 204. Forexample, as a leading step within the routing subsystem 205, a typicalapplication, or episode of use, proceeds with waypoint input 231,typically selected by the user, including a starting place, a finaldestination and optionally one or more mid-points or intermediatelocations where the user may stop or pass through in his or her travels.Waypoints include departure points and destinations as well asintermediate or mid-route waypoints. Waypoints are listed in the usersintended order of travel. The system 200 facilitates waypoint input forrouting functions by a variety of means, including database searches, asdisclosed for input of points of interest (POIs) within the multimediablock 209.

Next, in the course of a typical operation performed within the routingsubsystem 205, the user prompts the computation of an initial route, oroptimal travel path, between entered waypoints at step 245. Suchsoftware routing computations generally entail known methodologies forthe manipulation and calculation of data comprised of vectors, linesegments or sets of geographically located points or line intersectionssequenced in temporal order or order of the occurrence of events relatedto travel or motion in geographic space. The user can calibrate or tunerouting functions in order to compute either the shortest, quickest, orpreferred route, among other parameters, as disclosed hereafter.

Based on user optimized route computations, step 259 next expedites oneor more computer displays, graphics, hardcopy, text, audio or otheroutput, representing the initial route as computed along the waypointsinput by the user. Such routes are represented as various forms ofitinerary including: (1) annotated maps upon which the optimal routesare graphically marked, accentuated or highlighted; (2) lists ofwaypoints, or place names or geographic coordinates typically arrangedin the order encountered along the route; (3) point to point directionshow to take the optimal computed route indicating turning points,landmarks, navigation aids, signposts etc. along the computed route alsotypically arranged in temporal order of travel; (4) various combinationsof the three forms of route output or itinerary just listed.

As pictured in FIG. 1N, the preferred route output includes map displaysor map hardcopy with the optimal route highlighted, marginal traveldirections in an easy to follow format with the point of departureconsistently at the map bottom, and the destination near the top of thestrip map format. Alternative embodiments express such route informationoutput in pure form at step 259 in FIG. 2, by employing other graphicsor map formats, images, text and numbers, or sound/voice output toconvey the recommended or optimal itinerary or route.

On the other hand, a typical operation or program can begin on themultimedia side 209 with user entry of one or more points of interest(POIs) selected by the user inputting individual POIs or by databasesearches, sorting for specific predefined types of POI, relatedcharacteristics, or linked data or information using the underlying GIS201. In FIG. 2, to set up a presentation of multimedia placeinformation, the user can perform individual or manual POI input at step243. For example, a vacation traveler can request multimedia informationon two or three popular resort locations recommended by friends, ads ortravel articles by using well known data entry methods such as keying inthe resort names, or nearest place name, or geographic coordinates. Thesystem 200 is further able to locate individual POIs for input byenabling a user to select from lists of place names, or through linkedphone exchange, zip code or geographic coordinate data. The user canengage in manual input of individual POIs by clicking at points, symbolsor place names on the map display.

In fully developed embodiments of the CARS system 200, steps 243 and 255work together within the multimedia subsystem 209 to enable the user toexecute database searches for desired multimedia input. Step 255 enablesand manages automated POI sorts or searches in order to generate, amongother tasks, one or more lists of locations or POIs, about whichinformation is available in the underlying database system 201 aspotential content for multimedia presentation in step 273. For example,step 255 facilitates user searching for resorts of a predefined typee.g. skiing, tennis club, theme park, etc.; or for a list of resortswith specific characteristics including low cost, desired climate,nearby attractions or transport, etc.; or for a list of resorts linkedto certain data or data types e.g. graphic images, hotel reservationaccess, or banquet or conference facilities information, etc. In step243, the user can then either edit the results of such database sorts,or input the entire list of resort locations produced by such a databasesearch. Whether manually entered by the user or taken from a userdesigned database search, POI input at step 243 calls forth multimediainformation presentations concerning the resort location inputs.

As already noted, step 231 waypoint input within the routing subsystem205 can involve identical database searching processes, as well asmanual input of individual locations. This specification uses the termwaypoint to refer to a routing input item at step 231 in the routingsubsystem 205. POI for point of interest is the term generally reservedfor an item of multimedia input at step 243 in the multimedia subsystem209. Terms such as place, location or geographic object refer todefinite points, loci or sites on or proximate to the surface of theearth. Such loci, points or sites are associated in the GIS 201 withparticular or ascertainable geographical coordinates e.g.latitude\longitude, plus an index of elevation, altitude or depth asappropriate, A single unique place, location or geographic object couldbe both a waypoint i.e. a routing input item and a POI i.e. a multimediainput item. Outputs and inputs are transferred between routing andmultimedia as part and parcel of important applications of the systemtechnology.

Within the multimedia subsystem 209, step 273 facilitates diversemultimedia information presentations or output on places, locations orgeographic objects listed as POI or multimedia input in step 243. Thestep 273 output or multimedia presentations are subject to flexible usercontrol, inviting further user response and interaction. The invention200 facilitates user participation in, and user control of, both theform and content of ongoing multimedia presentations. The multimediasubsystem 209 provides access to commands or user options for makingfurther manual selections of individual POIs, or further database POIsearches, even in the middle of an ongoing multimedia presentation. Instep 273, as detailed hereafter, the user can elect to repeat or skipparts of a multimedia presentation, pick among or combine forms of mediasuch as audio, text or graphics, alter the current POI list governingthe order and geographical focus of the unfolding ongoing multimediaexperience, or prompt alternative or more detailed multimediapresentations about the places of interest to the user.

Pure routing is accomplished entirely in the routing block or subsystem205. Block 205 generally illustrates a software process for routingwhich computes the temporal arrangement, sequencing and linear structureof travel or movement, between two or more places or waypoint locations,following specified transportation routes such as vehicular roads,hiking trails, shipping channels or flight paths, etc. Such routingcomputations are subject to adjustable parameters. For example, userscan opt to compute the shortest route in terms of the absolute traveldistance, or in the alternative, the quickest route in terms of thepredicted, elapsed time it will take to travel the route. Routing outputfrom such computations can also report estimated distances and expectedtime frames for an overall journey as well as discrete parts or segmentsof an optimal computed route. The users can engage exclusively inrouting functions, absent any intervening multimedia operations,starting at 203 and stopping at 275, all within the routing subsystem205.

Similarly, pure multimedia can commence at 204 and stop at 279,unfolding entirely within block 209, without reference to or interactionwith the routing subsystem 205. The term multimedia in this contextrefers to a broad range of audible, visible, legible, or otherwisehumanly perceptible data or information as stored, processed, output andtransmitted within and between computer systems. The GIS at 201,underlying the invention 200, stores, retrieves, manipulates and managesdiscrete units or items of information in various media in relation togeographic coordinates, Block 209 in FIG. 2 illustrates a multimediadatabase subsystem for flexible, user controlled, processing andpresentation of located information in various media and formatsincluding alphanumeric data, text, graphics, still or moving imagery,and sound, etc. which can be separate from routing,

The overall system 200, however, enables transfers of intermediate andfinal outputs between the independent routing 205 and multimedia 209processes or subsystems. Multimedia and pure routing functions, as justdiscussed, are blended or integrated essentially by sequencingmultimedia and routing operations under user control. Routing 205 plusmultimedia 209 subsystem operations, performed sequentially, producecombined or interactive output at step 265. The combined or interactiveoutput typically includes a unique, customized or personalized travelplan provided in the form of map displays or hardcopy maps annotatedwith information about places, and travel directions, with the optimalcomputed route highlighted, labelled or otherwise marked. Users can optto further embellish combined, interactive travel plan output withselected multimedia graphic images, videos, animations, sound or voiceoutput as well as text, documents, numeric or tabular data aboutlocations, POIs or points of interest or other geographic objects alongthe way i.e. on or near the computed optimal route. One preferred formof such combined travel plan output is illustrated in FIG. 1N.

User interaction with routing and multimedia, as illustrated at step265, gives a combined interactive output that reflects choices made bythe user. Step 265 output integrates the user's decisions about waypointinput or routing calculation parameters, plus the user's selection ofindividual POIs or multimedia inputs derived from database searches,along with the user's interaction with and responses to multimediapresentations. For example, in order to revise or refine his or heremerging itinerary, the user can modify an initial route by altering thecurrent waypoint list adding places he or she really desires to visit,or excluding places from the itinerary, in response to selectedmultimedia information about the locations found along the initialroute. The system 200 further enables users to attach or includemultimedia selections to or with travel plan output i.e printouts,audio, screen displays, etc. As shown at 265 in FIG. 2, combined outputincorporates the user's choices and interests as exercised through oneor more interactions with and between the routing 205 and multimedia 209subsystems.

FIG. 2 illustrates the invention's capability for combined interactiverouting and multimedia about locations, in the middle block 207, andrelated lines portraying operational flows between the routing block 205and the multimedia 209 block. Pathways for transfers of intermediate orfinal input/output among the routing 205 and multimedia 209 subsystemscoinciding with pathways for sequencing combinations of multimedia androuting operations are illustrated by solid lines with one-way arrowssymbolizing a single direction of flow e.g. 233, 235, 241,247, 251,261 &269.

As disclosed in detail hereafter, various input/output transfers andcombined routing/multimedia operational sequences take place through theinteraction bus 237. Within the middle block 207, the interaction bus237 facilitates repetitive, looped or iterative operations as well asuser interactions producing combined output at step 265 by sequencingmultimedia and routing operations. For example, the system 200 enablesusers to blend pure routing output generated at 259 with subsequentmultimedia operations by transferring data via path 261, the interactionbus 237, and path 241 to the multimedia input step 243. In this manner,users can prompt a multimedia experience of information focused uponplaces found along the way i.e. within a preset distance of, or in auser defined region around, an initial route or set of waypoints. Thusin typical operations, the invention 200 sequences prior routing andsubsequent multimedia operations to generate route based multimediainformation presentations on locations or points of interest along aninitial route. Output 259 from prior route computations gets transferredfrom block 205, the routing subsystem, through the interaction bus 237,over into the multimedia subsystem 209 which then absorbs the route dataas multimedia input at step 243. The user can then pick and play one ormore multimedia presentations about points of interest or geographiclocations found in the vicinity of the current optimal route highlightedon the map display.

In the examples just cited, the geographic content of the subsequentmultimedia presentation is circumscribed by the prior routing operation.As detailed hereafter, location data from the routing subsystem 205focuses or sets the overall agenda for the following multimedia showabout places nearby the computed route. This location data comes to step243, to become multimedia input, through the interaction bus 237, viaprocedural and data transfer pathways at 261 and 241. Any resultingmultimedia presentations are no longer pure, in the language of thisdisclosure. Rather the multimedia has been combined with, and derivesits geographic context or structure from, the prior routing operation.Routing operations are also preceded by multimedia in other applicationsor uses of the invention 200, as disclosed hereafter. In those cases,the geographic context of the subsequent routing follows the lead i.e.the locational focus of the prior multimedia.

So called pure multimedia output at step 273 involves no prior routingoperations. No multimedia operations come before pure step 259 routingoutput. In FIG. 2, steps 257 and 271 distinguish such pure sequences ofoperations from mixtures or series of multimedia and routing functions.Given the existence of a prior routing step or operation, output fromsuch a combined prior routing and subsequent multimedia sequence ofoperations is shunted in step 271 away from step 273, reserved only forpure multimedia output. Output from a routing operation followed by amultimedia operation appears at step 265, arriving there by dint of thelogic of step 271, then path 251, the interaction bus 237, and path 263.Combined interactive output at 265 can also follow one or more priormultimedia operations followed by one or more routing operations. Insuch cases, data transfers and operational sequences follow the logic ofstep 257, through path 247, the interaction bus 237 and path 263,resulting in combined output at step 265.

The interactive system 200 facilitates additional iterations andcombinations. For example, during or after the playing of a multimediapresentation based upon an initial route computation as just described,the user can then decide to add or remove one or more locations orplaces from his or her itinerary as a matter of personal preference,responding to the multimedia experience. This additional operation getsdone by a transfer of the combined multimedia output from step 265,through path 267, looping back into the interaction bus 237, to becomerouting or waypoint input at step 231 via path 235. In this manner, theuser calls forth a new or revised route computation, via step 245, basedon his or her responses to multimedia information about points ofinterest found along the initial route.

The foregoing example of system usage focuses on a combined interactivemultimedia and routing process made up of a sequence of threeoperations: (1) an initial routing computation and output (R1); (2) amultimedia information presentation about places or points of interestfound nearby the initial route (M1); and (3) a re-calculation or amodification of the initial route output based upon new waypoint inputstemming from the user's response to the multimedia presentation (R2).In a shorthand notation, amplified below, this combined operation isformulated thus: R1, M1, R2=CO1. Equivalently in words, first routingoperation, followed by first multimedia operation, then second modifiedrouting operation yields first combined output.

Anytime that output results from a substantial sequence of routing andmultimedia steps, then the resulting combined output appears at step265. Steps 259 and 273 are reserved for pure output, meaning multimedianot preceded by any routing, as well as routing steps absent any priormultimedia, software decisions managed in steps 271 and 257respectively. Otherwise, steps 257 and 271 work to shunt the product ofsequences of multimedia and routing operations through the interactionbus 237 to appear as combined interactive output at 265 in FIG. 2. Sucha combined output could result from a single multimedia operationfollowed by a single routing operation. Moreover, one or more multimediaoperations can precede one or more routing operations. What is more, asexemplified hereafter, the CARS system 200 is capable of complex,prolonged iterations and operations composed of at least one multimediaor at least one routing operation combined with a plurality ofcounterpart operations.

As a shorthand notation for such combined or sequenced sets ofoperations, this disclosure employs the expression R1, R2, R3, Rx=RO1 todenominate a series of pure routing operations and its pure output asshown in step 259 in FIG. 2. M1, M2, M3, Mx=MO1 denote a pure multimediaoperational sequence and its multimedia only output as shown at step 273in FIG. 2. Thus, sequences of steps such as R1, M1=CO1 and M1, R1=CO2represent combinations of multimedia and routing operations productiveof combined, interactive output as shown at step 265 in FIG. 2. Thesystem 200 is capable of complex iterations and combinations ofoperations as, for one example, expressed in the following shorthandformula: R1, R2, M1, R3, M2, M3, M4, R4, M5=CO3.

As detailed hereafter the CARS system 200 enables even more complexoperational chains and loops, typically because the user is engaged inreplaying selected routing and multimedia steps or operations, usuallywith minor or modest variations of inputs and parameters, in an effortto refine his or her travel plan. Complex operational sequences alsooccur because the user shifts back and forth repeatedly between routingand multimedia tasks, for example, to play multimedia informationrelated to routes and waypoints appearing on the map display, or torevise their travel plans by altering the current list of waypoints inresponse to multimedia information about places and POIs,

Thus, the system 200 enables the user to generate, review, reshape,edit, improve, simplify, complicate or otherwise amend a custom,personalized or individualized travel plan. Travel plans are typicallythe product of a unique process of interactivity, consisting ofparticular series of routing and multimedia operations, arranged by theuser. The user can impose his or her idiosyncratic responses or personalchoices to shape each operation's form and content, or repeat and varyoperations, by adjusting parameters and by exercising commands andoptions disclosed in more detail hereafter.

The user can opt for a quick and simple routing operation or extensivetravel planning with multimedia input. For example, a user can employthe system 200 just to input Boston as a point of departure and New Yorkas a final destination, then compute the quickest route for automobiletravel between the two cities. Given more leisure time, however, theuser can elect to proceed with the invention 200 to experiencemultimedia about points of interest around the quick car route to NewYork from Boston, or to explore and compare rail, air or marine routesbetween these two cities. Moreover, in response to the multimediaexperience, this user can plan various side trips, or a much moreconvoluted route incorporating intermediate waypoints, including placesthe user wants to visit. Furthermore, the user can choose to compute acombined transportation route, for example, driving by car from Boston,Mass. to Providence, R.I., then taking a train to New Haven, Conn., withthe journey on to New York City completed by bicycle, or on foot.

After making an extensive travel plan, including more side trips orstopovers than available leisure time, the user can opt to edit orrevise down an overambitious travel plan. This task of prioritizing orselectively reducing a travel plan entails yet another series ofmultimedia presentations and routing computations, aimed at thediscriminating elimination of the intermediate destinations of leastinterest to the user, and the side trips or modes of transportationwhich involve too much travel distance or travel time. This disclosureemploys the shorthand notation explained above in order to help expressor describe such complicated sequences of multimedia and routingoperations in relation to the FIG. 2 block diagram, or more detailedflow charts presented hereafter.

The shorthand notation, proposed above, helps delineate and understandthe crucial ability of the invention 200 to facilitate a diversity ofrepeated or combined software operations. The interaction bus at 237,within the interaction block 207, enables pure sequences of iterativeoperations e.g. a series of routing operations only, as well assequential combinations of mixed multimedia and routing operations. Bytaking or following different paths through the interaction block 207,for example, the user can either recycle a pure routing operation, withdeliberate variations, or combine antecedent routing output withsubsequent multimedia operations to produce presentations of informationin various media related to the prior routing output. Vice-versa, theuser can repeat a pure multimedia operation varying significant details.Or the user can invoke an ensuing routing operation, after a multimediapresentation about locations or geographically located objects,typically in order to plan and map out optimal travel routes andtransport between selected places or points of interest experienced bythe user in the multimedia.

By way of illustration, in FIG. 2, the routing subsystem 205 enables theuser to compute and compare alternate routes or modes of transportation,by iterative or cumulative operations accomplished through theinteraction bus 237. Starting with an initial pure routing computation,such cyclical sequences of pure operations involve looping or feedingstep 259 output back up via path 261, through the interaction bus 237and path 235 in to the routing or waypoint input step at 231. In thismanner without any reference to multimedia information, the user replaysand reworks routing computations in order to insert or delete waypoints,or to try other parameters for routing.

For a concrete case, suppose the user first computes the quickest way byautomobile from Boston to New York City. The user has many options for asecond or followup routing operation, which takes the first routingoutput as the baseline input for one or more successive routingoperations. As a second phase for instance, the user can recompute thefirst route in order to compare the cost and benefits of travel by railor air or sea to New York City from Boston. In the alternative, as asecond operation of divining optimal automobile routes, the user can optto readjust software routing parameters, as disclosed hereafter. Then,the user can recompute and output the shortest route in total miles orkilometers, or the best roads and highways for wide or heavy truckloads, or the most scenic automobile route from Boston to New York City.Other optional routing software parameters also are described in moredetail elsewhere in the specification. Yet another option for a secondor successive routing operation is for the user to recompute the optimalroute from Boston to New York City, incorporating the user's personaldesire to stopover en route for an overnight visit with friends orrelatives living in Bennington, Vt.

In shorthand notation already proposed, all examples, just expressed inthe foregoing paragraph, of a second or successive routing operation getformulated as follows: R1, R2=RO2. This particular expressiondenominates a pure sequence, composed of two routing operationsproducing routing output only at step 259. Of course, the initial orfirst phase routing operation i.e. the quickest route by car from Bostonto New York, upon which later iterative operations are based, isexpressed as follows: R1=R01. The vital result is that the first andsecond routing operations produce first and second outputs i.e. RO1 andRO2 for the user to consider and compare in planning his or heritinerary. Such iterative or followup routing operations enable the userto evaluate and make choices between two or more alternate routes ormodes of transport by looping or recycling routing subsystem operationsthrough the interaction bus 237 and interaction block 207, withoutnecessarily involving multimedia.

In a similar fashion, the invention 200 enables the user to replaymultimedia operations in sequences, purely within the multimediasubsystem 209. For example, the first such operation would be expressedas M1=MO1. M1, M2=MO2 expresses a range of possible second phaseoperations in a pure multimedia only sequence. Such replaying within themultimedia subsystem 209 is accomplished by transferring or looping theMO1 output from step 273 at the end of first operation via path 269through the interaction bus 237 and path 241 to step 243 where thesecond or iterative operation can begin.

The formulae and pathways, cited in the foregoing paragraph, areconsistent with recycled multimedia operations such as the following.(1) MO1 comprises a multimedia presentation of all sports orientedresorts on the West Coast of the United States as found in a databasesearch. The user elected only to examine a brief text description abouteach of the 100 resorts found in the search, to browse for places to goon his or her vacation. (2) MO2 comprises a user selection or short listof 10 from the full MO1 list of 100 resorts. The user has chosen toexperience more multimedia information, such as digital photos or videosof selected resorts, voiced descriptions of the sports facilities, textconcerning nearby cultural happenings and price information in tabularform about the short list of 10 resorts picked by the user in browsingthe brief text descriptions about all 100 resorts on the MO1 list. Inyet a third phase multimedia operation, the user could review, composeand save selections of the multimedia information about the 5 personallymost appealing resort locations to share with his or her family.Including this third operation of editing down the list to five resortsand selecting related information in various media, the full sequence ofpure multimedia discussed in this paragraph is formulated as follows:M1, M2, M3=MO3.

The user may be content to show family members the MO3 pure multimediapresentation on his or her favorite five resorts. But the inventionenables further operational sequences at the user's election. Inaddition to or as an alternative to more operations in the multimediasubsystem 209, the user can choose to engage in diverse followup travelplanning functions utilizing the routing subsystem 205. Routingoperations, following up such multimedia operations, entail transferringthe resort POI data by way of path 269 through the interaction bus 237and path 235 to the waypoint input module at 231. Then, as describedfurther in relation to FIG. 4, the user can variously pick and arrangethe resort POIs or the nearest nodes subject to routing computations aswaypoints for one or more subsequent travel planning or routingoperations.

For example, the user might proceed to compute an optimized route fromhome to the one resort location most preferred by the whole family. Thisentails transfer of POI data on the selected resort from the multimediasubsystem 209 into the waypoint input module 231. There the user caninput the resort location, or the nearest routable node, as the ultimatetravel destination. The user's home address is entered as the point ofdeparture. Then, in step 245, the user can prompt the computation of thequickest, shortest or another optimized route, as detailed hereafter. Incombination with prior multimedia tasks developing a short list ofresorts, this one simple followup routing computation expands theoverall formulation to the following: MI, M2, M3, RI=C01. The firstthree multimedia operations can also be expressed in terms of their pureoutput M03, which the user can elect to save for later comparison and/oradded processing. Thus, the overall sequence of combined routing andmultimedia can be equivalently and compactly formulated as: MO3, RI=C01.In any event, CO1 stands for a combined output rather than pure output.Following up the antecedent multimedia selection of resort locations,the routing operation R1 proceeds by way of steps 245 and 257, then path247, through the interaction bus 237, down path 263 to step 265. Thereit becomes the COI combined output, typically in the form ofhighlighting the optimal computed route from the user's home to theselected resort on the underlying map display.

As just noted above, the system 200 lets the user save, compare orcontinue processing output from pure and/or combined routing ormultimedia operations. Although essentially equivalent to MI, M2, M3,RI=C01, for example, the formulation M03, RI=C01 indicates that theprior pure multimedia output was saved or memorized by routine means,then retrieved and combined with the RI followup routing operation.Similarly, the user can save the COI combined output for laterprocessing. This capacity of the invention 200 for later processing ofmemorized output, or operational sequences, enables the user to performa diversity of combined routing and multimedia based on the same initialset of operations such as produced the MO3 or COI outputs. This featurehelps to compare routes and compute multiple travel plans.

For example, instead of clearly preferring one resort on the MO3 list,based upon their experience of the MO3 presentation of multimediainformation, suppose that the user's family favors two resorts about thesame. The choice between the two resorts might depend on the travel costor distance or other factors related to the routes to the two resorts.In such cases, the invention 200 facilitates additional routingoperations combined with the prior MO3 output to aid the user comparingroutes and composing various alternative travel plans. MO3, R2=C02 isthe shorthand formula for a second followup routing operation from hometo the family's other favored resort, yielding combined output C02 forcomparison with CO1. Moreover, an extended family, whose members residein different places, but who are planning to vacation together, cancompose multiple travel routes from their respective homes to the chosenresort. All based on the MO3 list, here is a group of shorthand formulaefor various sequences of operations producing multiple routes to asingle resort for an extended family living in three different locationse.g. grandparents residing in Santa Fe, parents in St. Louis and a sonor daughter away at college in Chicago: MO3, R3=C03; MO3, R4=C04; andMO3, R5=C05. This capability of the system 200 to save the output fromoperational sequences, for later replay varying formats or inputssubject to the user's control, facilitates comparative or multiplerouting operations which the user can combine selectively withmultimedia information about places along the routes.

The invention 200 also provides for selectivity, flexibility anditeration in composing operational sequences so that the user can engagein extended integrated series of operations to develop and refine asingle personalized travel plan. Such unique custom or individualizedtravel plans typically culminate from sequences of pure or combinedmultimedia or routing operations. The system 200 is interactive i.e.enabling the user to control operational content, sequencing, parametersand media. This disclosure uses the term "interactivity" to describe howthe system 200 provides for flexible ongoing user control over the orderor sequencing of operations, and the exercise of optional commands andparameters, shown generally at 211, 215 and 219. User options aredescribed further relative to FIGS. 1B-1M and I-O to 1P which picturethe user interface for one embodiment. Command and parameter optionsthat influence multimedia or routing format, content or sequencing arealso disclosed in relation to FIGS. 3, 4, 7, 8A-8E. For one example, theuser can calibrate or adjust the module for routing calculations, at 245in FIG. 2, to get the quickest or shortest travel route, or otherpreferred or optimal parameters for routing computations, as detailedrelative to FIG. 4. For another example, paths 233, 235, 261, 263, 267,241, 251 and 269 comprise optional pathways for the transfer of locationdata and travel information in various media between the routing 205 andthe multimedia subsystems. Selecting among these pathways, the usercontrols sequencing, combination and iteration of multimedia and/orrouting, as detailed hereafter. Also, alternative options to start andstop operations shown at 203, 204, 275, 277 and 279 facilitate usercontrol over operational arrangements as well as input and outputformats. Moreover, the user exercises flexible controls over the medium,topical focus and substantive content of the geographic information ortravel presentations which are generated in the multimedia subsystem 209in FIG. 2, described hereafter in more detail relative to FIGS. 8A-8E.

Along with the capability to modify multimedia and routing parametersand content, the invention 200 provides user control over operationalsequencing and combinations, facilitating the production ofindividualized, custom, or personal travel plans. This disclosure usesthe terms "individualized, "customized" or "personalized" tocharacterize output generated with substantial user interactivity. Evenin the example previously cited, where the user only opts to compute thequickest automobile route from Boston to New York City, the userexercises choice over the point of departure and the travel destination.More user interactivity productive of custom output is illustrated bythe added selection of intermediate waypoints, such as Hartford Conn.and Providence R.I., and the specific order of travel between waypoints.User choices or interaction are also enhanced by the capability forcomparison of varied routing parameters e.g. scenic or shortest routeand varied modes of transport e.g. rail, bus, ferry, air as well asautomobile travel . The invention further enables individualized orcustom output by facilitating unique iterative, sequenced and combinedmultimedia or routing operations, according to the user's responses andpreferences while operating the system 200.

Customizing travel plans through the selective exercise of user controlsover the sequencing and combination of operations was alreadyexemplified above in the case of the resorts picked first in themultimedia subsystem 209. The user could proceed thereafter with variousscenarios for followup routing tailored to user requirements andpreferences. Comparing and evaluating alternate destinations and routesenabled the user to develop or refine individualized travel plans,reflecting "roads not taken" or selectively deleted waypoints as well asexplicit travel information. Such customized travel planning oftenentails some operational sequences being repeated with the user varyingthe format, content, media and parameters involved in succeedingoperations. Such systematic variations help the user to decide aboutalternative waypoints, transport, points of interest, or variableinformational forms and content, in order to compose a personal travelplan. Travel planning is typically individualized by the usercontrolling transfers and integration of data between the multimedia 209and the routing 205 subsystems by means of user selectable pathwaysthrough the interaction bus 237. For instance, individualized travelplans are further facilitated by operational sequences, commencing inthe routing subsystem 205, which are then combined with followuppresentations in the multimedia subsystem 209.

For example, going back to the case of planning travel from Boston Mass.to New York City N.Y., the user commenced operations at 203 in therouting 205 rather than the multimedia subsystem 209. On the one hand,the user can conduct sequences of pure routing, adding intermediatewaypoints and varying routing parameters, as formulated for example bythe short hand expression RI, R2, R3=RO1. Other even longer pure routingoperational sequences could involve added evaluation of alternate meansof transport. On the other hand, the invention 200 provides the userwith commands or options for variously interposing multimediaoperations.

FIG. 2 depicts the flexibility or user options as provided by theinvention 200 for variable or custom sequences of routing and multimediaoperations. For one instance, having done no more than enter Boston asthe starting point plus New York City as the final destination in thewaypoint input module 231, the user can choose to transfer operationsand data via paths 233 and 241, and prompt multimedia presentations onthe attractions, accommodations and other geographically locatedinformation about Boston or New York City, which are stored in the CARSdatabase. This option is further described in relation to FIG. 4,particularly step 431. Alternatively, the user can opt to transfer tothe multimedia 209 only after computing and displaying an optimal routefrom Boston to New York through steps 245 and 259 in FIG. 2. Then, paths261 and 241 enable access to a variety of subsequent multimedia aboutBoston, New York City, or points of interest or POIs found along orwithin a certain user defined region around the optimal route. FIG. 4especially step 471, FIGS. 5, 6A and 6B, and related text, furtherspecify this process whereby POIs are found or located along the way orwithin a user defined distance from a computed route or its componentwaypoints. In sum, the sequences of operations discussed in thisparagraph generally reduce in the shorthand notation as follows: R1,M1=CO1. The one multimedia operation, following one prior substantialrouting computation or waypoint input operation, logically generatescombined output 265 via path 251, the interaction bus 237 and path 263.

The invention 200, particularly the 207 subsystem governing interactive,iterative or combined operations, enables more individualized travelplanning by means of varied combinations or sequences of operations. Forexample, pathways 251 and 235 offer the user the opportunity followingthe R1, M1 sequence to return to the routing subsystem 205. The usercould then add, delete or insert waypoints selected in response toinformation experienced back in the multimedia, as detailed hereafterrelative to FIG. 4. As detailed more in relation to steps 465 and 467,the user can also return from the multimedia 209 to the routingsubsystem 205 to attach multimedia information about POIs to adeveloping travel plan, or to alter the dimensions of the region aroundthe user's intended route in which the system 200 searches for POIs andrelated multimedia information. By returning for an added routingoperation, the user enlarges the general formulation of sequencedoperations in shorthand as follows: R1, M1, R2=C02. C02 combined outputgets done at 265 via paths 247 and 263. The M1 multimedia step isrecognized as "prior" to R2 in step 257.

As already disclosed, the invention 200 lets the user stop and output ormemorize RO1, CO1 and C02 or other output from any valid sequence orcombination of operations. As emphasized and exemplified below, theinvention 200 also facilitates much more extensive series of operationsrefining and individualizing the user's emerging travel plan by repeatedand varied multimedia or routing operations. Extending the example inthe last paragraph, new waypoints or routing computations, performed inR2 after returning from the preceding M1 multimedia operation, may temptthe user to further explore multimedia information. As detailedhereafter, new waypoints or altered route computations can oftengenerate added POI inputs about locations found around or along the newwaypoints or computed route. Further exploration of the new POIs throughan added multimedia operation entail an expanded sequence of operationsas follows: R1, M1, R2, M2=C03. In turn the added multimedia explorationM2 could provide information on locations motivating the user to returnyet again to the routing subsystem 205, for example, to insert or deletemore waypoints at 231 as a matter of personal or individual preference.This added operation expands the formulation as follows: R1, M1, R2, M2,R3=C04. Moreover, the system 200 also permits repeated and variedmultimedia or routing operations within a given sequence. Thus, R1, R2,M1, M2, M3, R4=C05 is a feasible operational sequence.

Combined outputs C04 and C05 stem from relatively extensive operationalsequences. The invention 200 facilitates still more complex sequencesand combinations of operations, typically with more user interaction orexercise of user options built into the system 200. Therefore, as arule, the more elongated or complex sequences of routing and multimediaoperations tend to generate travel plan outputs which are more unique orindividualized. The invention 200 further enables the user to edit downor prioritize overdeveloped travel plans eliminating side trips orwaypoints of less personal interest, for example, in case time does notpermit an overambitious itinerary. Such editing typically results in asimplified, concentrated travel plan. But, this editing processnonetheless involves additional routing or multimedia operations inorder to delete less interesting waypoints or remove attachedinformation about lesser POIs. Thus, relatively succinct custom travelplans could result from extensive sequences of multimedia and routing.In sum, the invention 200 provides flexibility and control over thesequencing, media, parameters and substance of routing and multimediaoperations, yielding individualized travel plan outputs. Such travelplans are uniquely shaped and defined by the process of userinteractivity involved in developing each travel plan, and optionallyediting it down.

FIG. 2 also provides an overview of the user options and programcontrols, described in greater detail elsewhere in this disclosure as,for example, command menus, dialog boxes, control panels, adjustableparameters and global/local system settings. The user exercises suchuser options by command input and system management methodologies wellknown to software artisans e.g. conventional keystroke sequences; mouse,joystick or touch-screen manipulations on pertinent pixel locations,symbols and buttons; command text entries; voice-recognitiontechnologies; macros and batch commands; and equivalents. In variousembodiments, particularly embedded applications, such user controlmechanisms are consolidated, overlapping, redundant, or simplified, asdictated by consumer requirements, user friendly design criteria andanticipated usage patterns.

For conceptual purposes, FIG. 2 depicts three distinct controlinterfaces, one for routing 211, another for the interaction block 215and a third for multimedia 219. Simple dotted lines, at 213 and 217,indicate that all command and control interfaces are accessible betweenblocks or subsystems, one from another. Users involved in a routingprocess, for example, can stop in mid-operation and access theinteraction or multimedia commands and controls. Some implementationshave routing, interactivity and multimedia buttons or controls visibleon screen from within any given mode of operation, particularlysimplified versions of the invention and embedded applications.

In FIG. 2, the broken dotted lines, at 221, 225 and 229, represent twoway connections between substantive steps and the user option managersfor any given mode of operation. Line 221, for example, means that theuser is able to control and define any and all routing input,calculation and output parameters by setting or adjustment before aparticular operation. Moreover, the user can halt, suspend or detachfrom an ongoing operation to manipulate relevant controls and settingson the fly. Control lines 225 and 229 represent similar connections andcapabilities for user option management within the interaction block 207and the multimedia block 209 respectively.

FIG. 3

FIG. 3 is a flow chart illustrating the organization and procedurallogic of the commands or user options available to multimedia users ofthe preferred embodiment of the CARS system. The system combinesmultimedia and routing to provide a software utility for personal andbusiness travel planning. FIG. 3 depicts data transfer pathways as wellas the hierarchy of commands and user options available to users in thePoints of Interest system listbox or dialog box shown in FIG. 1J. In themultimedia mode, the user can call up this dialog box on top of the mapdisplay which typically dominates the computer screen.

FIG. 3 relates to the user options 219 and POI input 243 steps foundwithin the multimedia subsystem block 207 in FIG. 2. In FIG. 3, dottedlines and reference numbers delineate the margins of the routing 205 andinteraction 207 subsystems portrayed in FIG. 2. FIG. 3 shows theparticular multimedia user options and commands for POI input andpertinent data transfers embodied in the CARS system in relation to themore generalized FIG. 2 system block diagram.

In FIG. 3, processing begins at reference letter C. The user canactivate the multimedia mode at 301 in the first instance for purposesof composing fresh or new multimedia presentations uncombined with prioroperations. Activation of the multimedia mode facilitates user access tothe user options and commands shown in FIGS. 1J, K, L, M, O and P aswell as FIG. 3. From C, the user proceeds to step 319 to select or getfresh POI inputs for multimedia presentations implemented by loopingback through C to steps 305 and 307. This is how, in the vocabulary ofthis disclosure, pure multimedia is started by the user from scratch,uncombined with prior routing or multimedia. But, the user can alsorecycle pure multimedia through C typically for replay with variationsin media, focus, contents or locations.

Entry point C plays a pivotal role in recycling multimedia presentationsand combining routing and multimedia. During or after multimediapresentations, the user can return to C proceeding to replay multimediashe or he has just experienced, by recycling the prior multimediapresentations through steps 305 or 307 typically in order to vary themultimedia form, content or focus according to the user's interests, asdisclosed hereafter in more detail in relation to FIGS. 7, 8A-8E. Instep 319, the user is able to amend or revise preexisting POI inputlists, on which prior multimedia was based, by adding or deleting pointsof interest or locations to or from the preexisting list. This alteredPOI list sets up a new variation or altered geographic foci formultimedia replay implemented by looping around through C to step 305 or307. Moreover, multimedia presentations can derive from or combine withoutput from prior routing, as shown, entering C at 303 in FIG. 3.

Either to start a fresh pure multimedia presentation or to modify one ormore pre-existing POI lists, the user proceeds from C to step 319 inorder to get and decide on POI inputs in several ways. Users can get andmanually enter one or more POIs typing in place names, geographiccoordinates or other literal location indicators. The user can alsoseek, pick or delete POI input by browsing lists of locations, or othersituated data, and choosing points of interest. Moreover, the user canemploy cartographical or graphic means in order to locate potential POIsto be added to or deleted from the current POI input list. Thistypically is done by positioning the cursor on locations, symbols,geographic coordinates, place names, etc. on the current map display.The user can manipulate the cursor position on the map display with themouse, arrow keys or other means in order to recenter the map display,causing it to shift or pan laterally to a new location centered on adifferent latitude and longitude. In summary, the "GET POI" operationsat 319 include user options to add, delete and rearrange the POI inputlist along with shifting or recentering the map display on the currentPOI.

Users can also opt for zooming down to a closer map scale for a moredetailed perspective or zooming up or out to get a more global outlookcovering larger territory. The CARS system utilizes such flexible andintuitive capabilities to zoom among map scales or shift across digitalmaps, seeking POI input, with map generation and cartographic databasetechnology as disclosed in the David M. DeLorme U.S. Pat. Nos. 4,972,319and 5,030,117. The user can also shift, or recenter, map displays tolocate POI inputs by entry of telephone numbers, zip codes, streetaddress information and other located or locatable data. The CARS systemprovides several textual or graphic methods for the user to get POIinput by means of selective commands and procedures made available atstep 319. The system also enables the generation and modification oflists of POI inputs by various methods for database searching andsorting well known in the art of computer programming.

In a typical usage of the system, the multimedia mode of operation ofthe invention is invoked at C, deploying the command and user optionarrangements illustrated in FIG. 3. POI inputs are transferred andtransformed within the interaction block 207 into the multimediasubsystem 209 in the form of a list of POIs found in proximity to aroute previously computed, as revealed at 303 and detailed hereafter inrelation to FIGS. 5, 6A & 6B. Step 303 deals with output from a previousoperation of routing, transferred from the routing subsystem andtransformed into multimedia input for processing, subject to the useroptions and command organization shown in FIG. 3. In this fashion, theuser is enabled to selectively experience multimedia information aboutlocations and points of interest along the way or within a user-definedregion around i.e. circumscribing an optimal route already computed.Steps 309, 315 and 325 enable the user to return to and modify theprevious route or travel plan output with changes typically based on theuser's responses to an intervening CARS system multimedia presentation.

FIG. 3 illustrates the commands and user options made available to usersupon startup or recycling of the multimedia mode of operation of theCARS system. Through 301 and C, the user can make a completely freshstart on a pure multimedia process, proceeding to get and locate POIinput by a great variety of means at step 319. Step 319 is alsoavailable for users to get or revise multimedia input for amendment ofone or more pre-existing POI lists. Recycling of a preexisting list ofPOI input through C can involve pure multimedia inputs, generatedwithout reference to routing. As presented for multimedia processing at303, data transformed into multimedia input from previous routing outputillustrates POI input in the form of an amendable or modifiablepreexisting list which is not pure multimedia. Rather, it derives fromand is combined with previous routing operations.

The user can opt for a selectable multimedia presentation on any singlePOI input of his or her choice at step 305, described further inrelation to FIG. 7 hereafter. Such Show/Tell One operations unfold fromE, as shown in both in FIG. 3 and FIG. 7. After or in the midst of suchmultimedia presentations about a single POI or location, the user canreturn to C, typically in order to add or cull one or more POIs as justexperienced in multimedia to or from his or her travel plan. The usercan also prompt further presentations of located multimedia informationwhich vary in form, media or level of detail as detailed hereafter.Similarly, at 307, FIG. 3 depicts user options and commands formultimedia presentations on a total list of POIs. Step 307 Show/Tell Allfunctions proceed from reference letter F, as disclosed hereafter withrespect to FIG. 8A. The user is also able to return from the midst orconclusion of a Show/Tell All operation to C in order to browse themultimedia command set and user options in FIG. 3.

The system also enables the user to prompt multimedia presentationsabout a selected fraction of one or more POI input lists i.e. Show/TellCertain POIs by various methods such as concatenating individualShow/Tell One operations, or by means of searching for POIs of apredefined type or by sorting POIs as related to characteristic data.

For example, the system routing and multimedia utility presents the userwith at least four predefined types of POIs: (1) Points of Interest i.e.tourist, recreational and cultural attractions; (2) Hotels; (3)Campgrounds; (4) Restaurants. Thus, the hungry user can search formultimedia input on places to eat only, while the tired user can employwell known database sorting techniques to focus upon multimediainformation about places to stay for the night e.g. Hotels andCampgrounds.

The dialog box or organized set of commands and user options in FIG. 3also facilitates initial transfer or return of ongoing operations to therouting mode as well as termination of the multimedia mode of operationsin favor of some new or fresh operation or sequence of operations, or inorder to exit the program entirely. The user options in FIG. 3correspond to the 162 dialog box in FIG. 1-0 and the 161 quick menu.Steps 309, 315 and 325 allow access to, and modification of, subsequentrouting operations performed within the routing subsystem or block 205revealed from a more general perspective in FIG. 2. Step 327 provides anexit from the multimedia mode. Step 327 corresponds to step 279 andpartly to step 277 in FIG. 2. After exiting at 327 in FIG. 3, users cancommence fresh operations, on the one hand, by starting anew in therouting mode, as detailed elsewhere in relation to FIG. 2 and 4. On theother hand, exiting at 327, the user can begin a completely new orunprecedented multimedia operation, or sequence of operations,reactivating the multimedia mode at 301, and then proceeding through Cin FIG. 3.

At 309, in FIG. 3, the user develops or alters his or her travel plan oritinerary by attaching selections of multimedia, as experienced in aShow/Tell operation. Such travel plans or itineraries are composed inthe system embodiment in part by the attaching of multimedia informationabout places and locations to the underlying map display on which ishighlighted previously computed optimal route output. FIG. 1Nillustrates one example of such travel plan output, adorned withannotations, pictures, and graphic arrows concerning points of interestas selected by the user in response to multimedia presentations on thoselocations or POIs, generated by the CARS system preferred embodiment.Different, more advanced embodiments facilitate attachment and locationof audio or video output, experienced in the multimedia mode, on digitaltravel plan outputs combining multimedia and routing as detailedelsewhere in this disclosure. Step 309 enables the user to transferselected multimedia through M to be attached to an itinerary or travelplan, as depicted in FIG. 1N, by processes described hereafter inrelation to FIG. 4.

In the lexicon of this disclosure, attaching multimedia refers to theprocess of picking, transferring and displaying multimedia aboutparticular POIs or locations through the interaction block 207 forinclusion upon travel plan output at 265 with reference to FIG. 2.Attached multimedia can comprise text annotations about POIs withgraphic arrows or pointers indicating the site or geographic location ofspecific POIs on travel plans in the form of map hardcopy or map displayoutput on which one or more routes are highlighted, as shown in FIG. 1N.Other embodiments enable attachment of still or moving images, sound,and various other media to travel plan output. Though such multimediaattachments invariably modify the informational content of travel plans,the definitive feature of travel plans with attached multimedia is thatthe highlighted computed optimal routing component has not been alteredby modification of the waypoint lists.

Instead, information about POIs, found along the way, is presented as asupplement or marginal note on a travel plan showing one or more optimalroutes already computed as depicted in FIG. 1N. Thus, attachedannotations or other selected multimedia about POIs or places, situatedalong the way or in vicinity of a precomputed routing output, constitutea preferred travel plan output format in cases where the user needsinformation on a travel plan about locations nearby one or more optimalroutes previously computed. However, the user does not require a revisedrouting computation based on new waypoint input chosen by the user whilebrowsing multimedia information about proximate POIs or locations.

Step 315 in FIG. 3 does facilitate transfer of POIs picked by the user,experiencing multimedia information about such POIs, over to the routingsubsystem 205 to be transformed into a new, or modified, list ofwaypoint input in order to prompt a new, or a revised or recycled,routing computation as described relative to FIG. 4. In contrast tomerely attaching prior multimedia information to travel plans by way ofstep 309, through step 315 the CARS system user is able to add or deletenew waypoints and highlight a newly computed optimal route based on hisor her experience of, interaction with and responses to multimedia placeinformation. This new or altered highlighted route output can appear atthe user's option without any supplemental information from thepreceding multimedia added to the user's itinerary. The user can alsoopt to include annotations, or alternate selections from the priormultimedia, embellishing the resultant travel plan output, along withthe optimal route encompassing new waypoint selections, based upon theuser's multimedia experience. In sum, step 315 provides preferred travelplan output in cases where the user wants a new optimal route computedin response to multimedia about pertinent places and locations.

Steps 309 and 315 apply both to transfers of pure multimedia, as yetuncombined with prior routing, and multimedia already combined withrouting, pursuant to step 303. In another form of expression, in theshorthand notation for sequences of operations presented above relativeto FIG. 2, steps 309 and 315 enable routing operations subsequent to,and combined with, multimedia in accord with both of the followingformulae:

    (1) M1, R1=C01; and (2) R1, M1, R2=C02.

In the two fairly simple examples just formulated, step 309 or 315 eachare interposed right after M1 to transfer data from the operation M1into the immediately ensuing routing operation. The first formularepresents a case of output from a pure multimedia operation M1transferred through step 309 or 315 for subsequent processing in therouting subsystem. The second formula represents a transfer of an outputfrom a combined sequence of routing (R1) and multimedia (M1) via step309 or 315 to become input for one further routing operation (R2). Theinvention can facilitate more complex combinations and sequences ofmultimedia and routing functions in order to produce combined outpute.g. C01 and C02 that incorporates and reflects the user's uniqueresponses to, and interaction pattern with, the flexible technology.

In FIG. 3, step 325 enables users to return to the routing subsystem 205to modify parameters on which a previous routing computation was based.For example, as one possible response to a multimedia experience derivedfrom previous routing at 303, the user can elect to go back to therouting mode by way of step 325 in order to prompt computation of theshortest rather than the quickest route, or to shrink or swell the userdefined region around the route from which POIs are extracted, asdescribed in more detail in relation to FIGS. 4, 5, 6A and 6B. Ofcourse, such selection criteria are fully adjustable by user from withinthe routing mode. Step 325 provides the system user with a quick returnfrom the multimedia mode or subsystem 209 for a corrective readjustmentof routing computation parameters or the distance from a route or set ofwaypoints within which POIs are recovered as potential input forsubsequent multimedia. This is a convenience to the user when a list ofroute related POIs as provided in step 303 is far too long or far tooshort.

The user can quickly enlarge or diminish the user defined region aroundthe route, or alter the manner in which the route is computed, in hopesof generating a POI list of a more useful size as potential input formultimedia. For example, suppose no hotels or eating places turn up asPOIs along a particular stretch of highway, step 325 then lets the usergo right back to the routing mode or subsystem 205 in order to calculatea more local route along which he or she can hope to find food andlodging. Or, the user can readjust the system selection criteria toprompt the system to search for hotels and restaurants at an increaseddistance from the exits off the major highway. Readjustment of theradius or area searched for POIs is also detailed hereafter in relationto step 467 in FIG. 4. FIG. 4

FIGS. 4A,4B, and 4C are assembled to form the flow chart referred tohereafter as FIG. 4. FIG. 4 is a flow chart illustrating the processesand user options included in the routing mode of a preferred embodimentof the CARS system. The system is a component software travel planningtool which combines multimedia and routing. FIG. 4 relates to theoperational sequences, data transfers and user controls implemented byway of the Manage Route dialog box depicted at 138 in FIG. 1G. The usercan access this suite of tools, commands and processes, invoking therouting mode of operations, by calling up the Manage Route dialog box ontop of a portion of the map display which pervades the computer screenin typical applications of the system.

FIG. 4 illustrates the specific user options and processes embodied inthe CARS system corresponding to the routing subsystem 205 shown at amore generalized level in FIG. 2. FIG. 4 also depicts pathways forinput/output data transfers to and from the multimedia operating mode,as shown at 403. Connectors A, M and N comprise the pathways or channelswhich facilitate the combining of multimedia and routing operations invarious sequences at the user's option, as described in relation to FIG.2 and in other places in the specification disclosure. In the vocabularyof this disclosure, FIG. 4 illustrates both pure routing i.e. uncombinedwith multimedia and operations yielding combined output at step 453which result from an integrated succession of multimedia and routingsoftware functions. Because step 453 handles both pure routing outputand output combined with previous multimedia, step 453 in FIG. 4corresponds in part to step 265 and embraces step 259 in the moregeneralized FIG. 2.

In FIG. 4, processing commences and is recycled through H. The useractivates the routing mode at step 401, in order to start a freshrouting operation, for example. Thus, step 203 in FIG. 2 corresponds tostep 401 in FIG. 4. Pathway 403 shows how the user can transfer from themultimedia mode to subsequent routing operations in order to transformthe output from previous multimedia operations into new or revisedwaypoint input for one or more succeeding impure routing operations i.e.routing that has been modified by the user in response to precedingmultimedia operations. Therefore, pathway 235 in FIG. 2 is analogous topathway 403 as shown in FIG. 4. Path 403 stems from step 315 in FIG. 3.

In FIG. 4, steps 406, 409, 411, 413, 415, 417, 419, 421, 423, 425, 427and 429 comprise the waypoint entry module in which the user can engagea suite of commands in to add, clear, delete or insert waypoints orrouting input. The specific process for waypoint input shown here inFIG. 4 corresponds to the more generalized step 231 in the FIG. 2 BlockDiagram. The user is also able to access waypoint input commands whilein the multimedia mode, in order to provide for immediate transfer ofPOIs to become input for new or recycled routing operations. Asportrayed in the FIG. 2 block diagram at 211, 213, 217 and 219, an usercan access commands and options betwixt and between the routing 205,interaction 207 and multimedia subsystems. For clarity in thisdisclosure, however, waypoint input operations are presented as promptedand executed within the routing subsystem.

In FIG. 4, steps 406 and 409 mean that the user can opt to exit from orclose the waypoint input module. Like virtually all operations embodyingthe invention, waypoint input is achieved on top of a computer mapdisplay, which becomes part of the waypoint input interface, asdescribed hereafter. In the lexicon of this disclosure, waypoints areroute input items including one point of departure, one finaldestination and, optionally, one or more intermediate loci entered inorder of travel. Waypoints are highlighted as input with inverted greentriangle symbols on the map display as shown at 147 in FIG. 1G. Asentered, waypoints also appear on a list in the order to be encounteredon the intended journey, as shown in the Manage Route dialog boxillustrated at 138 in FIG. 1G. The list of waypoints arranged in plannedorder of travel in the Manage Route dialog box corresponds to step 411in FIG. 4. The user works in the waypoint entry module or command suiteuntil he or she elects to close the function at 406 and 409, or tocompute a route at 433, or to transfer waypoint input through 431 inorder to experience selected multimedia information about the waypointlocations and nearby places.

Consistent with methods for the management of ordered lists well knownin software, the module for waypoint input enables the user to add oneor more waypoints to the end of the waypoint list at 413, clear allwaypoints at 415, or delete one or more waypoints at 417. Routingrequires at least a starting place and a destination i.e. at least twowaypoints. Step 419 recycles empty or single item waypoint lists forfurther input to meet this requirement. Step 421 facilitates theinsertion of one or more new waypoints at places chosen by the userbetween or before other waypoints on a preexisting list. In this way,the user can amend a waypoint list starting out from Boston going to NewYork City by inserting Hartford en route. Or, the user can insert LosAngeles or Mexico City as intermediate stops or places to pass throughon his or her planned trip departing from Boston and ending in New YorkCity. After specific waypoints have been cleared, deleted or inserted,steps 423 and 425 implement those changes by rearranging the currentwaypoint list in accord with the user's revised or amended order ofplanned travel.

Even entry of a fresh waypoint list can cycle several times through Hwhile the user is engaged in revising his or her initial input.Moreover, the waypoint entry module also enables the user to edit andalter a waypoint list from which an optimal route has already beencomputed and displayed. In such cases, a user adds, deletes or insertswaypoints relating to a previously computed route. Then steps 427 and429 function to clear away the old route display, anticipating a newroute computation which will incorporate the user's new waypoint listbased on revision of the old waypoint list.

The system enables input and alteration of waypoint lists by means of anarray of list based locating tools that can search zip code, phoneexchange and place name indexes, as shown in FIGS. 1D, 1E and 1F. Themap display recenters on new locations thus selected by the user. Also,the user can employ graphic/cartographic means for the selection ofwaypoints and related manipulation of the map display. For an example,users can choose waypoints by pointing and clicking upon symbols orplace names or at specified pixel locations on the digital map displaywhich correspond to geographic coordinates of places or objects situatedon or adjacent to the earth's surface. Graphic, intuitive waypoint inputlocation is further facilitated by capabilities to zoom amongst mapscales and detail levels as well as panning or shifting to recenter themap display upon a different place or set of geographic coordinates.

The first release in July 1994 of the Map`n`Go ™ Atlas of North Americaon CD-ROM by DeLorme Mapping Freeport Me. 04032 includes a version ofthe CARS system that limits the nodes or routable waypoints to specifiedintersections of selected roads and highways, and car ferry terminals.In alternate embodiments of the CARS system and enhanced commercialversions, routing or waypoint input can encompass airports plus flightpaths, bus stations and bus routes, railroad terminals and tracks,subways and other urban transit systems, off-road vehicle travel, trailsfor bicycles, hiking and other pedestrian paths as well as oceanic,coastal and inland shipping channels, also boat launches, portages andriver passages for canoes or rafts, plus other commercial andrecreational transport and travel means. Even more generalizedpoint-to-point routing more or less "as the crow flies" over rasterizedor digitized computer maps can be added. The present system isapplicable to a broad range of point and vector data structures familiarin the routine arts of geographic databasing and digital cartographyincluding but not limited to the foregoing specific input/output formatsfor waypoints or POIs as detailed in relation to FIGS. 5, 6A and 6B.

The system technology is designed to take user travel planningrequirements into account. Waypoint inputs are ordinally structured.First on any waypoint list is a single point of departure. Bydefinition, waypoint lists end with one final destination. In between,stops and places to pass through picked by the user are arranged in theorder of intended travel. Thus, a first waypoint list consisting ofBoston, Hartford, New Haven and New York City is not the same forexample as a second waypoint list which calls for leaving Boston, goingto New Haven, then Hartford, on the way to New York City. Waypoints areinput in an ordinal or serial data structure which is a representationof the user's intended order of travel: (1) first, the starting place;(2) second, initial intermediate waypoint; (3) third, next stop orwaypoint; N-1th intermediate waypoint; and Nth waypoint, finaldestination or end of planned journey. Intermediate waypoints areoptional, of course, but get entered in a specific order correspondingto the user's intended itinerary. Even before any computation of theoptimal routes between a set of waypoints, waypoint input is alreadyarranged in a data format descriptive of the user's overall planneditinerary.

In enhanced versions, step 431 facilitates the transfer andtransformation of ordinally structured waypoint input data over throughthe interaction subsystem 207 into the multimedia subsystem 209 so thatthe user can browse multimedia information about the input waypointlocations. Transformation of the waypoint input into the POI ormultimedia input format is involved, as detailed hereafter in relationto FIGS. 5, 6A and 6B. Step 431 in FIG. 4 approximates pathways 233 and241, as shown in FIG. 2. Step 431 in FIG. 4 concerns waypoint inputonly, in advance of any routing computation based on said input. Step471 transfers output from subsequent routing computations for multimediaexposition. Step 431 further enables the user to intelligently refinehis or her current waypoint list by prompting and experiencing selectedmultimedia information on chosen waypoints. In response to suchmultimedia information, the user can return to the waypoint input modulevia 403 in to order make more informed choices about which waypoints tokeep or delete and in what order to travel.

This disclosure confines the term routing output to output fromcomputation and display operations at steps 433 through 453, as detailedhereafter. Waypoint input operations, transferred to multimedia via step431, still qualify nonetheless as substantial routing steps oroperations for purposes of making up a valid set of routing andmultimedia operations combined in sequence within the inventivetechnology. This is because ordinally structured waypoint input can bedistinguished from random location data, or even from a list of POIsselected manually by the user or from a database search based onpersonal interest or links to specific topics or subject-matter.Waypoint input describes the user's point of departure, plannedstop-overs or intermediate waypoints and ultimate destination in order.

By contrast with an alphabetical list of regional hotels, or ahandpicked list of the user's favorite type of resort, the rudiments ofa travel plan or itinerary are presented in the standard waypoint inputstructure consisting of a list of locations ordinally arranged in orderof planned travel. For sequences of operations employed in thisdisclosure, waypoint input entered in such an ordinal data structuredoes qualify as a substantial routing operation. Therefore, theexpression R1, M1=CO1 can describe an operation of waypoint inputsucceeded by a related multimedia presentation which produces outputshaped by the user's interaction through the combination of substantialrouting and multimedia functions.

In the simplified embodiment of the CARS system the user can choose tobrowse one or more of the following lists: (1) Points of Interest i.e.tourist or cultural attractions; (2) Hotels; (2) Campgrounds; and (3)Restaurants. Alternative embodiments incorporate a broader range ofwell-known techniques for storage, retrieval and correlation ofgeographic or cartographic data. For example, customer and salesprospect information can be stored in a relational database linkinggeographic locations with various personal, business and financial data.Such a database would be useful for diverse sales, service, delivery,property survey and security functions, particularly to prepare travelor route plans with multimedia digital photos of valued prospects orreal estate. Utilizing such a relational customer database, sales forcepersonnel can evaluate and locate prospects and established accountsneeding a sales call, then extract the pertinent street addresses aswaypoint input in order to prompt computation of an efficient,comprehensive route for making a round of sales calls.

Similarly, service and delivery personnel can plan their work for theday or the week on the road. Appropriate databases can help identifyprime properties or security trouble spots. Real estate or securityagents can input the street addresses or other location identifiers fromthe database in order to compose a waypoint list as input for thecomputation of an optimal route encompassing the properties of interestto the agents. With the waypoint list at step 411 and the background mapdisplay, alternate embodiments of the invention incorporate a variety ofwell-known databasing methodologies in order to enable the user todesign, implement, output and further process diverse searches forwaypoint input. In like fashion, waypoint lists can be memorized andrecalled for later use or modification.

Step 411 and the map display interface also facilitate the processing ofcanned or prepackaged sets of waypoint inputs in addition to individualad hoc waypoint input lists made by users planning personal travels inthe waypoint entry module. Thus, the present invention enablesprocessing by the user of prepared lists of particular types of museumsor recreational facilities, for example, with database links to thepertinent street addresses or other location identifiers such aslatitude\longitude. The user may purchase such digital lists ofpotential waypoints on software media e.g. diskette, CD-ROM, PCM-CIAcards etc. as a data accessory for use in the system. Such prepackagedlists of waypoint inputs can also be downloaded via modem from anothercomputer or a central service bureau. Such prerecorded lists includesets of business or residential names and addresses linked to certainfinancial or demographic data. Alternatively, an off-the-shelf travelplan might include a recommended list of waypoints for a selected regionor user interest. Utilizing the waypoint entry module, the user can thenmodify or personalize and customize such prerecorded waypoint lists. Toassist with the task of individualizing a canned list, the user caninvoke step 431 to consult selected multimedia information concerningthe predefined waypoints, nearby resources and attractions.

In FIG. 4, steps 433, 437, 438, 439, 440, 441, 443, 445, 449, 450 and452 comprise the routing calculation or computation module includingrelated user adjustments and options, corresponding to steps 245 and 211in FIG. 2. As implemented in steps 433, 437, 438 and 439, such routingcomputations generally involve known methodologies or processes for themanipulation and calculation of geographically situated data in the formof vectors, line segments, networks, nodes, or other sets of geographicpoints which represent specific transportation systems or permissibleroutes. These methodologies facilitate computation of optimum routes orpathways in relation to the temporal order of planned travel or movementthrough space in spheres of human activity on or near the surface of theearth. Such processes or algorithms for the calculation of optimizedroutes may take into account factors such as the physical structure oftransportation routes, legal and customary rules of the road or othertransport systems, estimated or allowed travel speed, availabletransportation modes, schedules and connections, traffic, obstacles,currents, weather and other advantageous or limiting conditions.

For example, the July 1994 release of the MAP`N`GO ™ 1.0 on CD-ROMincluded a preferred embodiment of the invention, in the form of atravel planning utility, which computes quickest, shortest, or otherpreferred or optimal routes along major auto roads and selected carferries. This embodiment represents the available routes as certain linesegments on map displays which are drawn between the routable geographicpoints generally termed "nodes". The MAP`N`GO ™ 1.0 travel planningutility treats the following geographic points as possible waypoints ornodes: (1) major road and highway intersections; (2) the junctures orturning points of connected line segments representing the major autoroads and highways; (3) place names situated right on major auto roadsand highways; and (4) POIs located on or immediately adjacent to themajor roads or highways. To facilitate and speed routing computations inthis embodiment, every possible waypoint or routable node is stored inthe CARS database on the CD-ROM in association with a list of allimmediately adjacent nodes and the precalculated distance thereto. TheJuly 1994 MAP`N`GO ™ 1.0 travel planning utility computes optimal routesbetween selected and ordered lists of nodes or waypoints employingroutines based on the Sedgwick-Vitter algorithm disclosed in James A.McHugh, Algorithmic Graph Theory (Prentice Hall 1990) pp. 107-108. Thisembodiment permits the user to adjust parameters for the routingcomputations, such as speed settings and preferences for/against certainroad types as disclosed hereafter. The present technology works,however, with other transport system databases, various types of routesand definitions of routable nodes as well as alternative routingalgorithms and adjustable parameters.

As shown in FIG. 4, new or recycled routing computations follow input,recall or alteration of a particular waypoint list including a selectionof routable nodes which are arranged in an ordinal array according tothe user's intended itinerary or order of travel. Provided with input ofat least two waypoints, including one point of departure and onedestination, step 433 enables the user to select and execute variousrouting computation options. The system facilitates the followingalternative route computations: (1) Quickest i.e the route estimated totake the least time to travel between entered waypoints, even if over alonger distance on faster roads (step 437); (2) Shortest i.e the routewhich is the least distance in the actual miles or kilometers, etc. onemust travel even if the route takes more time to travel on slow roads(step 438); and (3) Preferred i.e. the user can select various roadconditions or types to favor or avoid, such as toll roads, forest roadsand routes involving car ferries (step 439). The Manage Route dialogbox, shown in FIG. 1G, facilitates user choice among the foregoingcriteria or variables for routing computations.

The Manage Route dialog box in the July 1994 MAP`N`GO ™ 1.0 travelplanner embodiment also provides access to a Preferred Routing dialogbox, shown in FIG. 1H, enabling the user to favor or avoid the followingroad types: limited access roads; toll roads; national highways, primarystate or provincial roads; lesser state and provincial roads; majorconnectors; forest roads;and ferries. The Global Speed Setting dialogbox in FIG. 11 enables users to adjust the estimated or expected speedof travel on each the foregoing road types in response to userpreferences or expectations with regard to a leisurely pace or need forhaste, weather, traffic, construction or vehicle problems which the usermight anticipate.

In FIG. 4, steps 440, 447, 449, 450, 452, and associated paths relate tothe menus or dialog boxes which enable users to choose various routingcomputation options such as Quickest or Preferred routes as illustratedin FIGS. 1H and 1I. Whenever the user elects to alter such routingcomputation variables, the CARS system loops or returns the user to theconnector H in FIG. 4 thereafter, giving the user a chance to modify thewaypoint list content or not. Then, the user can go to step 433 toimplement the altered routing computation. When the user chooses a newrouting computation option, for example to avoid one or more types ofroad in step 443, then step 447 determines whether there is any currentroute display needing to be cleared away or removed in step 452 beforereturning the user to H. Steps 449 and 450 administer similar displayhousekeeping chores in the cases where the user opts to adjust the speedon certain road types in step 441 or to favor selected road types instep 445. In other words, if the user modifies parameters for routingcomputation in step 440, after any necessary clearing of old displays in452, the user is returned to step 433 through H for execution of the newform of routing computation, with its new criteria for routing e.g.Quickest instead of Shortest route. The system defaults to computationof the Quickest route through step 433 in the absence of the userpicking another parameter. Steps 438 and 439 reflect routing computationoptions or variables elected by the user through step 440.

Other embodiments of the system provide further parameters or optionsfor optimal routing computations. Scenic routes can be identified in thedatabase of highways, roads and other modes of transport such that aminor routine modification of the overall routing algorithm program thenenables the user to prefer roads and transport which afford naturalvistas and ample opportunities for sightseeing. Similarly, enhancementsto the route database can address highway width, clearance and loadfactors such that the routing algorithm, with minor alterations, canoutput travel plans suited to the specialized requirements of truckersand heavy transport. Using programming techniques well known in thefield of geographic information systems and digital cartography formanaging located statistical data expressed in the form of map overlays,routing computations can be integrated with databases relatinggeographic locations with a broad range of situated conditions. Thus,users of the present invention can choose an optimal route computationwhich prefers or avoids high crime areas, particular environmental orweather conditions, residential versus industrial or rural as opposed tourban areas, even geocoded demographic or economic factors, provided theembodiment is linked to the appropriate databases.

Steps 453, 455,457, 459 and 461 in FIG. 4 constitute the module forrouting output and display including pertinent user options andadjustments, Insofar as no multimedia is combined with routing, step 453corresponds with step 259 in FIG. 2 i.e. routing output only. But, tothe extent that prior multimedia operations and outputs are mixed orcombined with a specific routing operation through path 403, steps 465and 467, then step 453 in FIG. 4 parallels step 265 in FIG. 2. In suchcases, step 453 produces output from combined multimedia and routing,mediated by user responses and interaction, involving at least onepreceding multimedia operation integrated with at least one ensuingsubstantial routing operation. For example, a prior multimedia outputcan get attached to otherwise pure routing output through step 465. Suchattached multimedia selections typically include a marginal annotationor digital image with an arrow symbol or graphic pointer indicating apertinent location on the map display as illustrated in FIG. 1N.

For another example of combined operation output at step 453, path 403facilitates the user transferring POI data from the multimedia subsystem209 through the interaction subsystem 207 to become new waypoint input,either expanding or shortening the current list of waypoint inputs. Anyresulting routing computation and its ensuing output at step 453, whichare based on this new list of waypoints, therefore incorporate theuser's responses to and interaction with the preceding multimediatransferred to the routing subsystem 205 via path 403.

As described hereafter in relation to FIGS. 5, 6A and 6B, step 467 inFIG. 4 readjusts the radius or, more generally, the size of the areaaround intersections or nodes along a computed route within which thetravel planning utility looks for POIs as topics for multimediapresentations. This technical process of resetting the geographic areato be searched for multimedia POIs comprises a substantial multimediaoperation for combination with routing insofar as readjustment of theradius or POI search area impacts on a map display also exhibiting routeoutput. Resetting the radius or the size of the region searched forPC)Is impacts on route display/output substantially whenever it causesPOIs to be added or deleted from the map display and the related POIlist as detailed in relation to FIGS. 5, 6A and 6B.

Steps 455, 457, 459 and 461 enable the user to choose among formats forthe routing display/output at 453 in FIG. 4. These steps correspond withthe more general options for mixed or pure routing output available tothe user in steps 215 and 211 in FIG. 2. As shown in FIG. 4, the useroptions selected through step 455 are controlled through dialog boxes,menus, text commands and other routine user interface technologies. Step457 enables the user to prompt route output in the form of a voice ortext list of waypoints presented in planned order of travel with orwithout verbal or literal travel directions and other locatedinformation associated with items on the waypoint list. Step 457 alsoallows the user to opt for such audio or text output either inconjunction with or in lieu of the map display or visual route output.

For example, while driving, the user of an in-vehicle embodiment canturn off the map display as an unnecessary visual distraction, usingstep 457 to retain spoken output about waypoints, route directions aswell as other located audio information pertaining to places along theway. Step 457 also permits simultaneous audio-visual output, forexample, so that the driver can listen to audio output about his or hertravel plans while a passenger is also looking at the highlighted routeand other information on the map display as illustrated in FIG. 1P. Step457 further permits turning off the audio output so the driver andpassenger can listen to music or converse while the passenger keeps aneye on the visual map/route display. Further details on audio/visualoptions for multimedia output, which can be combined with routing outputat 453, are disclosed in relation to FIGS. 7, 8A-8E.

Accessed through step 455 in FIG. 4, step 459 offers user options andcontrols related to combining multimedia selections with routing outputby attaching text, numbers, visual images or sounds or voice. In thecommand lexicon, attaching multimedia refers to processes wherebyselected information about locations gets included with map output, butwithout changing the waypoint input list. For example, the systemattaches annotations in the margins of standard strip map travel planoutput, as shown in FIG. 1N, with graphic arrows indicating relatedlocations on the background map. A typical text annotation includes thename, address and phone number of a cultural event or attraction: e.g."Pole-O-Moonshine State Park U.S. Route 9 (518) 834-9045" An arrowstretches from the box containing the text in the margin of the map,pointing out this park's location in Keeseville, N.Y. over on the mapportion of the travel plan in FIG. 1N.

Such text annotations can attach a broad variety of data and informationto map locations including historic facts, environmental data, personalcommentary, demographic, economic or political intelligence, news, evenads, jokes, folklore or fictional accounts relevant to the particularlocation and potentially of interest to the user. By its nature,however, attached information provides supplemental information aboutplaces or objects located on or near some pre-existing routedisplay/output. In the example above, the state park is not made a newwaypoint i.e. it is not treated as a new waypoint input. Rather, thelocation of the park is pointed out near or along the route display withsupplemental information about the park presented in a marginal textannotation. Attach "buttons" are shown for Hotels and Restaurants in the154 and 156 dialog boxes in FIG. 1L, also for campgrounds in the 158dialog box in FIG. 1M.

The present invention facilitates other forms and methods to attachinformation about locations. For example, to enhance a hardcopy travelplan for making sales calls on the road, step 459 facilitates attachingdigital photos of sales prospects beside marginal notes detailing theirname, personal interests and past purchasing history. This locatedinformation aids the user not only to find sales prospects' locationsbut also to recognize the prospects' faces, remember names and create amore effective and personable impression. Similar attached photographicimagery proves useful with various travel plans: (1) photos of landmarksas navigation aids; (2) digital pictures of drop-off sites, loadingdocks and other shipping terminal facilities to aid truckers and otherdelivery personnel; (3) images of industrial facilities, homes,buildings and land as seen from the road to enhance travel plans forreal estate surveys, private security, public safety, etc.; and (4)attached digital photos enhance scenic or sightseeing travel plans. FIG.1N illustrates attached digital photos of people and property. Attachedimages of faces, places or other located content are not limited tostill digital photo imagery except in hardcopy output. The systemenables attachment of videos, extensive alphanumerical text or voiceinformation about places or POIs, or situated music or natural sounds tomap/route displays.

Along with the marginal note or image box format, attached material canbe accessed by clicking the cursor on an appropriate symbol located uponthe map/route display. Attached visual and audio material related to theplace picked by the user can then be played selectively on the fullscreen, interrupting the map display for a brief or lengthy time period,at the user's option. In the alternative, the user can attach multimediaselections about locations appearing in windows superimposed uponmap/route displays as illustrated at 162 and 165 in FIG. 1-0. These canalso be printed out in hardcopy covering portions of the underlying map,as well as in marginal notes or accessible alternative screens.

Contrasting with attached multimedia, step 461 in FIG. 4 facilitatescombined map/route displays and output whereby the locations or POIsselected by the multimedia user do become new waypoint or routinginputs. In effect, step 461 enables the user to choose a routingdisplay/output format which adds, deletes or inserts POIs selected bythe user in multimedia using the module for waypoint input. Instead ofjust attaching multimedia information about places along a pre-computedroute, step 461 causes entry of locations picked by the user in responseto multimedia as new waypoint input. Step 461 reformulates the currentwaypoint list by recycling operations through H. Unless the user choosesotherwise, new waypoints are inserted after or before the closest oldwaypoint in accord with the user's old order and direction of travel.This new waypoint input in turn prompts a new route computation throughstep 433 resulting in a corresponding new route output at step 453. Step461 provides a preferred means for combining routing and multimediaoutput in cases where the user desires or requires computation/output ofa new optimal route based on a new revised waypoint input list includingor eliminating locations according to selections by the user made inresponse to his or her experience of multimedia concerning thoselocations.

The quick menu box at 161 in FIG. 1-0, for example, enables the user toadd, delete or insert waypoints in response to multimedia informationabout locations.

Steps 457, 459 and 461 implement concurrent or overlapping map/routedisplay/output options. In other words, for example, the user can electto have step 459 attachments as well as a new waypoint list as providedin step 461. In the alternative, attachments without any new or revisedrouting or waypoint input, or a new route based upon altered waypointinput but without attached multimedia, are also valid options. In sum,the display/output adjustments provided in steps 457, 459 and 461 can betoggled on/off independently.

Whatever the format and content of a step 453 route output/display, step471 enables the user to transfer to the multimedia mode from saidrouting output/display. Thus, any route output or display can becombined with subsequent multimedia, typically in order for the user togather more information about an emerging travel plan and the places onhis or her itinerary. Consistent with the objective of facilitatingflexible sequences and combinations of routing and multimediaoperations, the user can eventually return from playing multimediaselections after such a transfer from step 453 through step 471 in orderto work on further routing operations, returning via path 403, step 465or step 467. Transfers through step 471 entail transformation of routingdata into a multimedia format, as detailed in relation to FIGS. 5, 6Aand 6B.

FIGS. 5-5C

FIG. 5 illustrates cartographic data structures as seen on typicalmap/route display output in 501 in the upper left drawing. Underlyingcartographic data arrangements, typically not seen by the user are shownat 526 (upper right), 551 (lower left) and 576 (lower right) of FIGS.5A,5B, and 5C. They are used in alternative embodiments of the presentinvention to interrelate nodes or routes with POIs found in one or moreuser-defined regions around an ordinal series of entered waypoints oralong a previously computed route. FIG. 5, 5A, 5B, & 5C help to explainhow the present invention enables the user to transfer from substantialrouting operations over into the multimedia mode to experiencemultimedia presentations about POIs or points of interest located withina certain distance of a previously computed route or input waypointlist. These figures reveal general geographical data formats wherebyprior route output or substantial waypoint input is transformed into alist of POIs, situated around or along the previous routing output orwaypoint list. Data transformations in this manner are done inanticipation of the user selectively playing multimedia informationconcerning the POIs on the resulting POI list.

Relative to other parts of this invention disclosure, FIGS. 5, 5A, 5Band 5C sketches a framework for comprehending the data transformationinvolved in transferring operations from the routing subsystem 205through the interaction subsystem 207 for added processing within themultimedia subsystem 209 as shown in FIG. 2. The result of such datatransformations is a list of POIs, potential multimedia input, shown atstep 303 in FIG. 3. Such data transformations are prompted by the usertransferring from substantial operations in the routing mode throughsteps 431 or 471, as shown in FIG. 4. FIGS. 6A and 6B illustrate thedata transformation process whereby ordinal waypoint input or routingoutput becomes a list of POIs found around or along the previouslycomputed route or previously entered waypoints. FIGS. 7, 8A, 8B and 8Cgo on to show how the user can select and play multimedia about POIs orlists of POIs. With regard to the object of the invention to integratemultimedia and routing, FIG. 5 outlines the specific cartographic datastructures and overall processes for the data transformation whichfacilitates prior routing operations being combined with ensuingmultimedia operations.

FIG. 5 comprises one illustration of a map display at 501 as presentedon screen to the user in almost all embodiments and typical utilizationsof the CARS system. 501 is a simplified version of a typical electronicmap with a computed route displayed by graphic accentuation, asillustrated in FIG. 1G. While such a map display might not be presentedto users in some applications or episodes of use e.g. audio output onlyembodiments or full screen presentations of graphic images oralphanumeric documents about locations, multimedia and routing functionsgenerally are accomplished by means of the cartographic and geographicalinformation structures illustrated as typically displayed to the user at501.

The illustrations at 526, 551 and 576 of FIGS. 5A, 5B, and 5C representalternative transparent arrangements of the basic data formats embodiedin 501, demonstrating three variant methodologies for circumscribingPOIs. At 526 in FIG. 5A, POIs are listed as retrieved within circles ofa specified radius e.g. 538 centered on geographic points termed nodes,which are essentially road or highway intersections. At 551, a linebuffer graphic data structure i.e. an equidistant enclosure around aline segment at 561 encompasses POIs found along the route asrepresented by the line segment. At 576 and 588, one or more irregularpolygons drawn manually by the user, or computed by another algorithm,serve to capture a particular set of POIs related to the antecedentrouting data.

More specifically, 501 in the upper left of FIG. 5 shows a simplifiedmap display. Such map displays appear on the computer screen serving asa graphic interface in practically all modes of operation and variousembodiments of the present invention. The map display in 501 is centeredupon a location named PLACE, for purposes of this illustration, situatedin between SOUTH PLACE and NORTH PLACE, representing municipalities orparts thereof. As is routine in conventional map making and digitalcartography, these entities are represented on maps by their nameswritten on the map with the place name situated on the map in relationto its actual geographic location. Sometimes, place name labels on mapsare visually associated with a located symbol, such as a dot orpolitical subdivision boundaries or colored area on the map. No suchgraphic symbols are associated with the underlined place names in the501 illustration, however, in the interest of a simpler drawing.Generally, place names comprise a particular cartographic data type. Inthe underlying geographic information system or database, specificgeographic coordinates are linked to each place name. Storage,retrieval, manipulation and linkage of place names are done by means ofwell known list based, spatial, relational, and other databasemethodologies which are routinely used for management of geographicpoint types of data.

The present invention further employs such routine databasemethodologies in order to manage another geographic point type of datanamely, the POI or point of interest. POIs appear on the 501 map displayas boxed labels e.g. THING at 505. Each POI is placed upon the mapdisplay in relation to a certain latitude and longitude, or other set ofgeographic coordinates, related to a specific location on or near thesurface of the earth. CAMP, EAT, POLICE and FUN also comprise POI namesor labels upon the 501 map display. In consumer travel planningembodiments of the present invention, POIs typically representaccommodations and recreational attractions. For example, the July 1994release of MAP`N`GO ™ by DeLorme Mapping Company, Freeport Me. 04032,included the following predefined types or subtypes of POIs representedon the map display by various colored symbols: (1) Points of Interesti.e. tourist, recreational and cultural attractions essentiallysymbolized by red arrows; (2) Hotels also, motels, inns, etc. symbolizedby yellow diamonds; (3) Campgrounds symbolized by green triangles; and(4) Restaurants by blue circle symbols. Such symbols indicating theavailability of multimedia information on certain types of POIs areillustrated at 157 in FIG. 1M, for example. For purposes of a simplifieddrawing, in FIG. 5, no such POI symbols appear on the map display shownat 501. On the 501 map display, EAT represents a Restaurant POI; FUN isa particular example of a Point of Interest type of POI; CAMP is acertain Campground POI; and HOTEL exemplifies a Hotel type or subtype ofPOI.

But, POIs are not confined to tourist attractions and travelaccommodations. Alternative embodiments of the present invention handlea great variety of public facilities or infrastructures as geographicpoint type POI data e.g. POLICE as shown on the 501 map display. Locatedor locatable objects in geographical space can also qualify as POIs e.g.THING at 505 on the map display shown at 501. THING might comprise afixed landmark of human or natural origin. THING might also comprise amoveable object such as a vehicle, another item of personal property, amigratory animal or species, a person on foot, or other non-stationaryphenomena as currently known, estimated, or predicted to be at aparticular location. POIs can also include intended locations such asthe proposed location of a building, a place to meet, or the site of aplanned event. The term POI or point of interest lower case encompassesextensive types of geographical point data identified with or related tolocated or locatable objects which can be input, described, depicted andaccounted for in a multimedia database.

At 510, 512 and 514 in FIG. 5, waypoints comprise a third major type ofgeographic point data, in addition to place names and POIs. Waypoints isa term utilized in this disclosure for the starting place, ultimatedestination and intermediate locations to stop or pass through on anintended trip. Such a waypoint list is a user selection and ordinalarrangement of the routable nodes or geographic point components of thetransportation routes or modes of travel subject to routing computationsin a given embodiment. To plan automobile travel on national highwaysand state roads, waypoints are typically defined in terms of roadintersections or turning points in line segments or vector datarepresenting routes customarily traveled by ordinary automobiles. Forexample, waypoints are defined in terms of road intersections and jointsbetween the straight line segments used to represent normal automobileroads and highways in the routing and multimedia software travelplanning utility included with the MAP`N`GO ™ digital atlas of NorthAmerica on CD-ROM, released by DeLorme Mapping, Freeport Me., 04032 inJuly 1994. Any place name is linked for purposes of system functions tothe nearest node i.e. road intersection or other juncture between linesegments representing roads.

For various alternate embodiments, in order to address marine, airflights, off-road, pedestrian or other forms of transport and travel,waypoints are structured according to the physical and mappablecharacteristics of those other ways of going places. For example, travelby air involves available airports, private planes and commercial lines,safe and customary flight paths, terrain obstacles, etc., which becomefactors or building blocks for appropriate air waypoint data structures.Travel on foot is also constrained by legal and safety issuesexemplified by sidewalks and crosswalks as well as issues of customarypaths or trails and natural terrain limitations plus artificialobstacles, etc. Subways, buses and other public ground transportationsystems and public or private marine travel also require waypoint datastructures appropriate to the mode of transportation, taking intoaccount factors such as available stops, stations, terminals or docks,regular routes, connections and schedules, human or natural obstacles,safe navigation practices, etc. Ordinary cars and railroad travel areplainly confined to certain routes and tracks. Travel by air, foot andboat takes place in a more open spatial context still constrained,however, by customary or legal paths or channels and physical obstacles.In the FIG. 5 map display at 501, waypoints 510, 512 and 514 arestructured as nodes coinciding with various intersections of ordinaryautomobile roads and highways.

In the 501 map display illustration of FIG. 5, nodes 510, 512 and 514have been entered in that order as waypoints for a planned trip fromSOUTH PLACE, through PLACE to NORTH PLACE. The resulting optimal routecomputation is being displayed or output by graphical accentuation orhighlighting of the recommended route as shown by the fine dotted linesaround the optimal route 503 on the 501 map display. This highlightedroute is identical with the two-part line segment, representing theroute, illustrated at 528, 553 and 578 in the 526, 551 and 576 drawingsof FIGS. 5A, 5B, and 5C.

The 501 map display illustration further discloses a typicallatitude/longitude grid system of horizontal latitude lines e.g. 507 andvertical longitude lines e.g. 508 visibly superimposed as a locationalaid over the map display. Such grid systems also are composed in termsof alternate geographic coordinate systems, such as UTM, State Plane aswell as proprietary or arbitrary grid systems used for particular mappublications. Capital letters on the right side in conjunction withroman numerals that run across the top of the map display form a typicalsystem for identifying or naming individual grids, as a visual user aidfor a variety of common map interpretation, cross-referencing andindexing chores. For example, the POLICE POI is found in the C-IV grid.

Such grid systems may comprise more than just a visual user aid. Thepresent invention is typically, though not necessarily, implemented inconjunction with a geographic information system, or GIS, which managesspatial data with reference to interrelated matrices of quadrangulargrids or tiles constructed substantially parallel to lines of latitudeor longitude. Map database systems of this kind are detailed anddisclosed, for example, in the David M. DeLorme U.S. Pat. Nos. 4,972,319and 5,030,117 also, in the now pending U.S. patent application Ser. No.08/265,327 David M. DeLorme and Keith Gray inventors, titled COMPUTERAIDED MAP LOCATION SYSTEM.

Map database systems or GIS organizing geographic data in terms oftiles, quads, grids or frames present several advantages disclosed inthe background art just cited. These advantages generally derive frombreaking down the massive amounts of data typically involved in a stateof the art GIS into discrete, identifiable, adjacent and related maptiles, quads, grids and frames to store, retrieve, manipulate andintegrate geographic information. Rapid generation or redrawing of mapdisplays, recentering or panning across seamless maps, zooming to closeror more outlying map scales, as well as the correlation of located dataand the management of cartographic computations are all enhanced by suchGIS which manage masses of geographic data in small quadrangular units.

Such mapping database systems do not necessarily display the underlyingsystem of map tiles, quads, grids or frames which are used behind thescreen by the software. For example, the user can typically turn griddisplays or longitude/latitude lines off or on, off to de-clutter thedisplay, or on for better map location and orientation.

In FIGS. 5A, 5B, & 5C, the drawings at 526, 551 and 576 illustrate threedifferent cartographic data structures, used behind the screen, for thetransformation from routing output or lists of waypoints into POI listswhich function as input for subsequent multimedia operations. The 526,551 and 576 drawings illustrate alternative methodologies, used inconjunction with the present invention, to capture POIs situated withinsome specified distance along or around previous routing output orwaypoints listed in order of intended travel. The preferred embodimentsof the system manage transformations from routing to multimedia datastructures utilizing GIS or map databases that organize geographic datainto tiles, grids, quads or frames. Illustrations 526, 551 and 576 eachreveal the same behind the screen or underlying system of grids or tilesfor efficient geographic databasing. To simplify these drawings, FIGS.5A, 5B, and 5C show a behind the screen database system of map quads orframes which correspond exactly with longitude/latitude lines and thegrid or tile naming system superimposed as a visual aid on the 501 mapdisplay of FIG. 5.

FIGS. 5A, 5B, & 5C also show POI data corresponding to the 501 mapdisplay. For example, the FUN POI in grid C-I upon the 501 map displayappears circled as P-F in grid C-I in 526, 551 and 576. Similarly, THINGat 505 corresponds to P-T at 536, 559 and 586. Other geographic pointdata are reproduced exactly from the visible 501 map display over intothe underlying behind the screen data representation in 526, 551 and576. Thus, starting point node 510 in SOUTH PLACE is the same as 534,557 and 584 in the other three data representations. 512, 530, 555 and580 all represent the same mid-journey waypoint near PLACE. Likewise theend of the trip is shown at 514, 532, 556 and 582. Moreover, thetwo-part line segment, which is the highlighted route from SOUTH PLACEthrough PLACE to NORTH PLACE at 503, is reproduced exactly at 528, 553and 578.

Reference numeral 526 illustrates the preferred technique of drawing acircle e.g. 538 around each node 534, 530 and 532 along a line segmentor ordinal set of waypoints representing a planned route. These circlesof a specified radius R at 541 define the tiles or quads within whichthe data transformation subprogram begins to search for POIs, asdetailed hereafter in relation to FIG. 6A. For example, the circle drawnaround node 530 prompts an initial search for POIs in the followinggrids: A-I, A-II, A-III, BI, B-II, B-III, C-II and C-III. Thispreliminary search turns up three POIs found within the intersectingtiles or quads: P-E=EAT; P-C=CAMP; and P-H=HOTEL.

As detailed hereafter relative to FIG. 6B, the next step within therouting to multimedia data transformation subprogram is to identify allthe POIs, just found in intersecting tiles or grids, that are also foundinside of the circle of radius R around node 530. In this case, thissecond step eliminates all three POIs just listed. But, POI P-F in gridC-I does fall within the circle of radius R drawn around node 534. Infact, using the 526 circle methodology, P-F is the only POI which getson the POI list presented as potential multimedia input at step 303 inFIG. 3. To check for POIs in each of the three circles, the 526methodology concatenates such searches of all the circles and sets ofintersecting grids or tiles around a succession of nodes, as detailed inrelation to FIG. 6A.

The 526 circle methodology is preferable for ordinal series of waypointinputs transferred through step 431 in FIG. 4. Such waypoint input istransferred before the computation of an optimal route. Therefore, theoptimal route between the entered waypoints is yet an unknown. Forsoftware simplicity, and particularly for conventional on-roadautomobile travel, the 526 circle technique is also preferred. Onordinary rural or urban automobile trips, the car and driver cannot turnoff the road between nodes or road intersections and proceedcross-country or through city buildings and blocks to adjacent POIs. Butnote that the 526 circle method misses P-H or HOTEL in grid C-IIadjacent to Rt. 66, which is likely accessible from the optimal routethat it adjoins.

Other embodiments additionally or alternatively use the methodologypictured at 551 of a line buffer i.e. a polygon enclosure which is drawnequidistantly at a specified tangential T distance all around a linesegment. The line segment at 553 represents the optimal route betweenthe nodes computed for the journey to NORTH PLACE, from SOUTH PLACE,through PLACE. Such line segments derive from routing computations, asdetailed in relation to FIG. 4, expressed at step 453 as output frompure or combined operations performed in the routing mode. This 453output then gets transferred via step 471 for ensuing multimediaoperations.

The user defined region outlined by the line buffer at 561 serves asimilar function to the circles shown at 526. In other words, the 551method begins searching for all POIs located in tiles or grids whichintersect the line buffer region. Next, searching is narrowed to producea list of POIs found inside the line buffer itself. Thus the line buffermethodology works with the steps detailed in relation to FIGS. 6A and 6Bhereafter except for substituting the tangent T for the radius R. Theline buffer technique does require extra code and algorithms forhandling routing output from step 471 in FIG. 4, at least whenimplemented in addition to the 526 circle technique.

In FIG. 5B, note that the line buffer methodology did capture POIs atP-H in grid C-II, and at P-C in grid A-III, where the 526 circletechnique missed these same POIs. The 551 method of the line buffer istherefore preferable in cases of POIs found between circles adjacent toand accessible to computed routes. The line buffer data structure isalso preferable for ground vehicles capable of off-road travel as wellas travel by air, boat or on foot i.e. transport which can handledetours and side trips off-route between nodes. On the other hand, themethod of circles shown at 526 is better for trips by rail or othertransport which stops only as scheduled at predetermined waypoints,without possibility of detouring or side trips off the beaten track.

FIG. 5C at 576 shows a third behind the screen data configuration forthe transformation of routing output and waypoint input in lists ofnearby POIs for subsequent multimedia presentations controlled by theuser. Instead of a circle or line buffer, the 576 method employs acustom or irregular polygon 588. Such odd polygons can be manually drawnby the user, employing known technologies for graphic input, or derivedfrom alternate algorithms for relating computed routes or specifiedwaypoints to surrounding POIs. For example, in the 576 drawing in thelower right of FIG. 5, there is an irregular polygon at 588, shown bydotted lines, that results from an algorithm which combines a linebuffer along a computed route as done in drawing 551 with a line bufferdrawn along major intersecting routes out to a certain distance from theintended route. But, note this more intricate algorithm can capture bothEAT=P-E and POLICE=P-P, which are some distance from the user's plannedroute, but readily accessible on Main Street. Such complex algorithmsrequire more code and slow the routing to multimedia data transformationprocess. This more complex algorithm is, nonetheless, a preferablemethodology for applications where a more refined model of accessibilityto POIs beside a planned route is desired.

FIGURES 6A-6B

FIGS. 6A and 6B illustrate the steps whereby the CARS system transformsrouting output or a waypoint list into a list of POIs. In relation toFIG. 2, such transformations take place in the interaction subsystem207. Waypoint lists are transferred via path 233, Pure routing output isconveyed through path 261. Routing output combined with prior multimediabecomes involved in the processes depicted in FIGS. 6A and 6B by way ofpath 267 in FIG. 2. In relation to FIG. 4, these same transfers passthrough connector A as also revealed in FIG. 6A. In FIG. 4, waypointinput approaches A by means of step 431. Pure or combined routing outputis delivered to A via step 471. FIG. 5, particularly the drawing of thecircle methodology at 526, provides background on the cartographic datastructures involved in FIGS. 6A and 6B.

FIG. 6A shows the bounds of the interaction 207 and multimedia 209subsystems with dotted lines and reference numbers corresponding to FIG.2. The processes shown in FIGS. 6A and 6B transpire more generallywithin the FIG. 2 interaction subsystem 207. FIGS. 6A and 6B worktogether via connectors A1 and A2. The FIG. 6A and 6B datatransformations culminate at C as seen in FIG. 6A, corresponding withstep 303 and C in FIG. 3.

A typical episode of usage of the processes depicted in FIGS. 6A and 6Bcommences at A. Step 601 comprises a node list from the routing mode.The 601 node list consists of waypoints ordinally arranged in order oftravel along the route coming either from the waypoint input modulethrough step 431, or through step 471 from the routing output module at453 in FIG. 4. For a new list of nodes fresh from routing, step 603initializes the overall transformation process.

As detailed hereafter, further processes explained relative to FIG. 6Bloop back through A1. Moreover, in an alternative embodiment, the usercan enter A1 at 605 in order to process canned or prepackaged node listsoffered as data accessories. A1 at 605 also provides access for the userto recall lists of nodes representative of ordinal waypoint input orrouting output from memory or from a database process. Unless processingof a list of nodes for a route between an origin and a destination iscomplete, step 607 leads to the processing of the next node. Afterprocessing of a list of nodes for the route is complete, it passesthrough 607 and C to the multimedia mode. Steps 608 and 610 get thecurrent node ready for the subsequent search for POIs.

FIGS. 6A and 6B search for POIs utilizing data structures depicted inFIG. 5 particularly the circle methodology sketched in FIG. 5A at 526.As depicted at 201 in the FIG. 2 block diagram, the present inventionpreferably works in relation to a geographic information system (GIS) ora mapping database system which manages massive amounts of cartographicor located information through use of tiles, quads, frames or grids. Thegrids comprise quadrangular units of geographic data stored, retrievedand processed relative to particular geographic coordinates. At step612, a circle of radius R is drawn around the current node as a firststep. Step 325 in FIG. 3, connector N and step 467 in FIG. 4 showprocedures whereby the user adjusts or resizes the radius R. Theparameter 563 in FIG. 5B indicates an analogous, adjustable parameter orcriteria, namely the line buffer tangent T, which is also variable atthe user's option in order to modify the size of the user defined regionsearched for POIs. Next, in step 612 in FIG. 6A, all tiles touched bythe circle are identified and listed in 614 for further processing inFIG. 6B. Step 616 does the housekeeping chore of setting up for furthersessions of tile gathering around subsequent nodes.

FIGS. 6A and 6B connect through A2. In FIG. 6B, by way of step 620, thedetermination is made whether the subprogram now at work has processedall the tiles from the list at step 614 in FIG. 6A. If finished withprocessing a given set of tiles, as touched by a specific circle, thenthe train of software steps is looped back up through A1. If still moretiles around a node and on a list do need processing, then step 620directs functioning to steps 622 and 624 in order to get the currenttile. Items is the term used in FIG. 6B for individual POIs as foundwithin first within tiles and then within circles. In effect, step 626sorts the larger list of POIs found within intersecting tiles andextracts a short list of POIs found within the relevant circle of radiusR centered on the current node. Said short list of items or POIs is thenproduced in step 628. Step 630 initializes this short list process. Step632 determines whether work on the 628 item list is complete, in whichcase operations look back up through A2 to 620. Steps 634, 636, 638 and640 function to place new items on the POI list and to avoid anyduplication of items on POI lists such as can result from overlappingcircles around close nodes.

OVERVIEW: FIGS. 7, 8A-8E

FIG. 7 assembled from FIGS. 7A-7C and FIGS. 8A-8E illustrate theflexibly organized suites of user controls and commands as procedurallystructured and made available on the multimedia side of the CARS system.Consistent with the object of facilitating user friendly capabilitiesfor combining routing computations and multimedia about locations, themultimedia mode of the present invention offers the user many selectionsand ways to interact with the overall technology. In relation to FIGS.7, 8B, 8C and 8D the specification details how users are enabled toselectively play available information about locations and situatedobjects picking among available audio modes e.g. voice, music, natural,or created sounds, graphic and pictorial images or alphanumerical text.The user can shape his or her multimedia experience by isolating thesevarious media and topics of interest. Users are also able to mix andintegrate multimedia contents and formats.

This flexibility and selectivity within the multimedia mode facilitatesand enhances two major groupings of user interactions with the inventivetechnology, combining multimedia and routing. The first relates to userresponses to the multimedia, choosing or deleting places or waypointsfor ensuing routing operations. The second group relates to responses tothe multimedia wherein the user picks, composes, edits or removesinformation related to geographic locations in various media and formatswhich then is attached to travel plan output. These responses areimplemented through steps 309 and 315 in FIG. 3, which transfer bothdata and operations from the multimedia mode to the routing mode. Inturn, these responses are combined with routing through pathway 403 andstep 465 in FIG. 4. Relative to FIGS. 3 and 4, more details arefurnished elsewhere in this specification on how user interactivity withlocated multimedia gets combined with routing computations and travelplan output by waypoint input list modification or the attachmentprocess.

In relation to the more general FIG. 2 block diagram, the softwarestructures and operations detailed hereafter referring to FIGS. 7 and8A-BE are concentrated in the multimedia subsystem at 209. FIGS. 7 and8A-8E and 8C detail processes as accounted for more generally inrelation to steps 219, 255, 265 and 273 in FIG. 2. Moreover, FIGS. 7 and8A-8E depict procedures which deal both with pure multimedia i.e. withno prior routing and combined multimedia operations i.e. which followand incorporate data from prior routing operations. As detailed inrelation to FIG. 3, the user can start playing multimedia aboutlocations using the structures and operations shown in FIGS. 7 and 8A-8Eand then go to the routing mode in order to compute an optimal itineraryfor a trip to selected locations.

But, the structures and operations depicted in FIGS. 7 and 8A-8E anddetailed hereafter are equally suited to play multimedia placeinformation after and in relation to locations or POIs found along anoptimal route or set of waypoints as derived from a prior substantialrouting operation. The data transformation process, for deriving POIsfor potential multimedia presentation from prior routing outputs orwaypoint input lists, is described in relation to FIGS. 5, 6A and 6Belsewhere in this specification. As disclosed in relation to FIGS. 2 and3, multimedia presentations are often combined with both prior andensuing routing operations in typical usages of the technology. Thesystem is designed to facilitate more or less complicated mixedsequences of routing and multimedia in which the user engages in orderto develop and refine custom or individualized travel plans.

FIG. 7

The operations illustrated in FIG. 7 commence through E at step 702. Theconnector E is also shown in FIG. 3, after step 305, which moregenerally represents the interface engaged by the user to prompt andmanage Show/Tell One multimedia information about a single selected POIor location. In the initial release of MAP`N`GO ™ 1.0 by DeLorme MappingCompany, Freeport, Me., this interface is accessed by pushing a buttoncalled Show/Tell One in the Points of Interest system dialog box a.k.a.the POI Listbox illustrated at 148 in FIG. 1J and at 162 in FIG. 1-0.For an example, typically the user points and clicks on one of the POIsas listed in this dialog box and then pushes the Show/Tell One button inorder to prompt multimedia about that particular POI. Relative to FIGS.2 and 3, other methods are detailed for users to locate and pickmultimedia POI input.

In FIG. 7, operations proceed from step 702 to both steps 704 and 706,which are implemented concurrently. The system defaults to availableaudio or pictures through steps 704 and 706. Audio output is played at710, with volume and other variables controlled at 716. As delineated inFIG. 7, for the July 1994 release of the CARS system, each POI in thedatabase of multimedia is associated with no more than one audio output.This is typically a 'short travelog narration with background music.Likewise, no more than one picture is associated with any given POItypically a digital photo of a museum, a unique natural site, an hotelor a restaurant found at the POI location, Other embodiments of thesystem include multiple still or moving pictures and additional,selectable audio outputs. Thus, if it is all that is available in aShow/Tell One episode, then a sound recording plays to its endwhereupon, the user returns at 725 to the POI Listbox. But, if a pictureis available, then step 708 shows it for a preset adjustable period oftime. Alternate embodiments of the present invention include multipleaudio or visual images related to individual POIs. The user can browse,edit and arrange flexible multimedia presentations about a single POIthrough routine manipulation of such multiple audio or visual materials.

At minimum, in the July 1994 release of the CARS system, every POI, forwhich there is information in the database of located multimedia, hasone related text message. Typically, such a POI text message literallytranscribes the optional audio travelogue narration. Variant embodimentsinclude multiple textual documents linked to individual POIscommunicating a broad range of information about the POI location indiverse alphanumerical formats. Examples include comprehensivedemographic, historical, or environmental information about locations,commercial or personal data about parties located at residential orbusiness addresses, running inventories or data tabulations pertainingto particular sites, and references to or excerpts from works of fact orfiction citing the location. The first release of the system softwaredoes provide detailed text information about rooms, amenities, prices,phone numbers, nearby attractions, etc. for an extensive selection ofhotels, campgrounds and other overnight accommodations as illustrated inFIGS. 1L and 1M, As released in July 1994, the system software providesthe Show/Tell One multimedia user access to such text displays as anelective option at 714 in FIG. 7. Alternate embodiments default to textoutput and extend the user options to focus upon specific topics ortextual content by means of routine state of the art software textsearch technologies. Audio and visual images are "played" to accompanyor substitute for text in alternate embodiments. The CARS systemdisplays such text at the user's option 714 in step 712 in FIG. 7.

In FIG. 7, steps 718 and 720 illustrate user options and controls whichenhance flexibility and selectivity of play in the multimedia mode.Dotted line boxes and connecting lines, as in 718 and 720 and between708 and 718, represent user commands, options, and controls madeavailable throughout a series of steps. Thus, for example, step 718options are available all during any sound 710 or picture 708 show andany text 712 display as well as any combinations thereof. As shown at748, 749 and 750, the slide control options at step 718 are essentiallybuttons of the familiar rewind, stop and fast forward types which letthe user replay, halt or advance any presentation in any medium. Moredetail is provided on these slide control options relative to FIG. 8D.

The CARS system displays pictures or optional text for a preset,adjustable time period. Steps 723 and 727 measure whether this timeperiod has expired and maintain the display of pictures or text untilexpiration of said time period. Step 720 extends this time periodwhenever the user elects to call up a dialog box in order to changedisplay settings on the fly or otherwise adjust format or output optionsfor ongoing multimedia. Consistent with overall invention objectives,these features let the user browse or sample multimedia informationabout a certain location with flexibility to dwell upon or reviewinformation of particular interest, or fastforward through lessinteresting parts of a presentation. Moreover, a presentation getsextended or prolonged while the user is adjusting the presentationformat or proceeding to attach selected POI information to his or hertravel plan, or to select or deselect a POI as a waypoint, for purposesof subsequent routing operations. These flexibility features not onlyenhance the user playing the multimedia in the first instance.Selectivity in the multimedia mode further enables the user to focusupon particular multimedia in order to pick POI locations fortransformation into waypoints, or to edit pictorial, text or audiotravel information for attachment to travel plans.

Steps 729 and 731 remove or end display of pictures or text when thepreset time period for display has expired. In the Show/Tell One module,steps 737 and 735 return the user to the POI Listbox i.e. to connector Cin FIG. 3. The user is also returned to the POI Listbox or mainmultimedia menu at the end of available recorded audio, or if the useremploys the 718 slide control in order to stop an ongoing multimediapresentation on a single POI, at step 725. Step 739 presents a modaldialog box routine, in effect, asking the user "Are you done?" whenevera text and picture presentation are complete. At this point, the usercan opt to select or delete the pertinent POI or the nearest node as awaypoint or to edit and/or attach multimedia information about the POIto an emerging travel plan. The user hits an OK button in step 741 inorder to return through step 743 to step 708 where the picture displayclock is restarted. Unless the user opts for a replay of the text optionat 714, steps 723, 729 and 735 time out the picture and return the userto the POI list box as shown in FIG. 3 and FIG. 1J at 148.

As released in July 1994, the CARS system enables the user to choosebetween Show/Tell One, as detailed relative to FIG. 7, and Show/TellAll, as detailed relative to FIGS. 8A-8E. Alternate embodimentsfacilitate filtering a short list of POIs from a larger list of POIs,according to a wide range of criteria and methodologies available in theart of computerized management of lists. In other words, given an arrayof 50 or 500 POIs found along a route or from a coarse multimediadatabase search or from a canned or prepackaged list of POIs,alternative embodiments of the present invention facilitate automatedsorting of the long list by obvious state of the art softwaretechniques. The user can then concentrate the subsequent multimediapresentations on POIs of particular interest with specificcharacteristics. Users of alternative embodiments can distill, condenseand refine long POI lists for more efficient multimedia presentation,using well known obvious technologies.

FIGS. 8A-8E

The Show/Tell All module illustrated in FIGS. 8A,8B and 8C typicallyprocesses entire lists of POIs derived from substantial routingoperations as detailed in relation to FIGS. 5, 6A & 6B. Alternatively,the Show/Tell All module processes POI lists as entered manually by theuser or derived from a database search within the multimedia subsystemas detailed relative to FIG. 2. Show/Tell All handles entire lists ofPOIs from various sources such as: (1) lists of route related POIstransferred from the routing subsystem at 205; (2) lists of puremultimedia POI input generated within the multimedia subsystem at 209;plus (3) lists of POIs derived from more or less complex prior sequencesof combined routing and multimedia operations, as described withreference to FIG. 2.

FIG. 7 presumes the underlying map display encompasses or is centeredupon the single pertinent POI. But, shown generally at step 307 in FIG.3 and detailed in FIGS. 8B and 8C the Show/Tell All command promptsmultimedia presentations about each item on an entire list of POIs.Depending on map scale and the distance between POIs, not all POIs on agiven list necessarily appear on the map display serving as backgroundand cartographic interface on the computer screen for practically allembodiments and usages of the present invention. FIG. 8A illustrates theprocess that automatically shifts or pans the map display, as required,to center upon the geographic coordinates of the POI currently the focalpoint of a Show\Tell All multimedia presentation.

The processes shown in FIG. 8A commence at connector F as also shownfollowing step 307 in FIG. 3. Step 307 corresponds to step 800 in FIG.8A. Step 800 presumes a current POI list of two or more POIs. Step 801initializes the process depicted in FIG. 8A, setting a pointer on thefirst POI on the current list. This pointer is incremented in variouscontexts revealed in FIGS. 8B and 8C hereafter. In the CARS systemembodiment, step 803 in FIG. 8A facilitates Show/Tell All operationslooping back up and reentering at F1 for a new cycle of map centeringoperations each time the Show/Tell All module is ready to focus on thenext POI on the current list. Step 803 serves further as entry point forseries of multimedia presentations that commence at some user selectedpoint along a previously computed route or part way down a POI list inalternate embodiments of the present invention.

Step 804 fetches the next POI on the current list i.e. the next POIwhich is about to become the focus or locus of a multimedia informationpresentation done in the Show/Tell All module. If the map display is notalready centered upon or does not cover this next POI as determined instep 806, then at 808 the map display shifts or pans to recenterapproximately on the geographic coordinates of said POI. For example,consider a POI list consisting of two items, namely offices located inLos Angeles and New York City. Assuming that Los Angeles is first on thelist, step 808 redraws the map display to center on the New York Cityoffice just as the multimedia about the New York office is about tobegin and right after multimedia about the Los Angeles site is completedor terminated by the user.

Even when the map display easily encompasses successive POIs on a givenlist, so there is no need to shift or recenter the map display, the CARSsystem indicates the current POI utilizing a characteristic graphicLocator Arrow on screen. Step 810 takes care of drawing such an arrow tothe next or newly current POI. Step 810 further removes the LocatorArrow which pointed to the preceding or old POI.

Step 811 determines whether the current POI is the last item on thecurrent POI list subject to a Show/Tell All command. If the processrevealed in FIG. 8A has reached the last item on the current POI list,then the forward slide option or button is dimmed or turned off in step812. Step 812 is a housekeeping matter. It makes no sense for the userto try and call for the next item on the POI list when the last item onthe POI list has already been reached.

The process illustrated in FIG. 8A concludes at connector F2 where theShow\Tell All multimedia processes start as shown in FIG. 8B. Withcertain differences to accommodate processing of entire lists of POIsrather than singular POIs, the processes illustrated in FIG. 8B roughlyparallel the software functions and structures revealed in FIG. 7. FIG.8B depicts flexible user options and protocols for managing multimediapresentations about the current POI in an entire list of POIs.

From F2, the operations illustrated in FIGS. 8B and 8C proceed to steps813 and 814 which are implemented concurrently. Although alternateembodiments of the invention might default to a text display ofinformation about the current POI, the Show/Tell All command of thesystem prefers available sound or audio output and pictures orvisual/graphic images. Available sounds, such as travelog narrations,are played at 818 from beginning to end subject to user control of audiovolume, tone, etc. in step 825. In alternate embodiments, audio outputcalls for user interaction or responses. The audio output pauses andwaits for an appropriate user response, proceeding apace if the userdoes not answer for a predetermined interval. The CARS system displaysavailable pictures for a preset, adjustable time in step 816.

The MAP`N`GO ™ July 1994 release automatically displays literalnonvocalized text as words printed typically in a window over the mapdisplay on screen only in the event that no sound or pictures areavailable relating to the current POI location. The interplay betweensteps 813, 814 and 821 demonstrate this logic. However, step 823 enablesthe user to opt for display of silent alphanumeric text information onscreen, supplementing available pictures. This feature addresses thepractical reality that, while audio-visual output is preferred for manyconsumer travel information embodiments, many users and installedsystems lack sound cards and speakers. Moreover, though audio output ispreferred as a rule for vehicle drivers alone who must keep their eyeson the road and instrument panel, under some circumstances, in vehicleusers opt for having a passenger monitor literal text and pictures inwindows on the map display, electing to turn the sound off to facilitateconversation or for enjoyment of silence or listening to music tapes ornews on the car radio for example.

More important, like FIG. 7, FIGS. 8B,8C illustrate interactive andarticulated options and structures for multimedia output that areorganized so the user can play, review, select, edit or merge locationinformation in diverse media. Thus, the user can focus on informationalcontent in accord with individual personal interests and preferences. Inother words, unlike the background art, the CARS system is not limitedto silent information in text format only. Nor is the system restrictedto canned still digitized photos, related text or audio concerning sitesin a general region, played from beginning to end without userinteraction. The present invention facilitates the flexible play,selection, and manipulation of multimedia information focused uponindividual POIs or specific user selected lists of POIs.

Moreover, as depicted in FIGS. 7 and 8B,8C within a multimediapresentation concerning a particular POI, the system embodiment enablesthe user to select, review and segregate portions of the availablemultimedia information with regard to both media and content. Thus, theuser can concentrate on the available informational content that is ofthe most immediate interest, using the medium or media most convenientor useful under the circumstances. Otherwise stated, this capability foruser-controlled, flexible and focused play of multimedia informationabout specified locations facilitates individualized, interactive userresponses. For example, users can make individual choices about whatPOIs to add to, or remove from, their list of waypoints along a planneditinerary based on their own selection among available multimediainformation about those POI locations. The first release of the CARSsystem further facilitates selective attachment of text informationabout POIs, picked by the user, to travel plan output generated bycombined or sequenced routing and multimedia processes.

Alternate embodiments of the present invention additionally facilitateediting and amendment of text attachments, attachment of selected visualimages or audio output, and the insertion or input of new orsupplemental multimedia located information through obvious, routinestate of the art programming techniques for storage, retrieval andmodification of multimedia data. For example, as detailed in relation toFIG. 4 and illustrated in FIG. 1N, embodiments for sales, real estate orsecurity agents attach digital photo images, or even video clips, ofparticular properties or people at the appropriate locations onspecialized travel plan outputs. Available technology further permitsattachment of audio messages to travel plan output at relevantlocations. Emergency or delivery personnel can recall and hear crucialclient messages or instructions in relation to the known or estimatedlocation of an emergency or delivery event. Relative to specificgeographic locations, personal snapshots or video, voice/audioexperiences recorded on tape or text recollections can be input, storedand recalled, utilizing the present invention as a digital travel album.Such diverse contents and media can be modified, revised and composedselectively together employing obvious, state of the art techniques forthe computerized manipulation of interrelated text, graphic imagery oraudio data.

Particularly for the preferred embodiments of the present inventiondistributed on read only CD ROMs, a Replace function facilitates orenhances usage as a digital travel album and the flexible manipulationof multimedia, as well as updating of the GIS database. The Replacefunction stores and manages added or updated information on the harddrive or other equivalent memory devices. By routine means forcoordinating various databases or memory devices, taking into accountthe geographic coordinates or other prominent information attributessuch as the time and date of data input, the Replace function furtheroverwrites or amends fixed information on the CD-ROM with added, updatedor corrected data, or deletions thereof, including cartography, text,audio or pictures. This facilitates for example correction of highwaydata reflecting new road construction, other updating and amendments ofmapping, multimedia and routing data, addition of personalizedannotations or images in the manner of a diary or photo album as well asthe selective editing and recomposing of the multimedia substance andforms for presentations and attachments. In summary, the Replacefunction offers the advantages of cheap massive permanent CD-ROM storagein conjunction with the flexibility and modifiability of read/writestorage devices such as hard drives and flash memory.

In FIG. 8B,8C the flexibility and selectivity of information content andmedia are enhanced by steps 819 and 827. These steps correspondrespectively to steps 718 and 720 in FIG. 7. In the FIG. 2 blockdiagram, the user can similarly access and adjust user options at steps215 and 219 from the more generalized steps for combined and puremultimedia output at 265 and 273. Steps 819 and 827 facilitateinteraction with and choice of information in relation to the temporalstructure whereby audio, text or visual information are played asillustrated in FIG. 8B,8C.

While step 818 plays prerecorded audio to its conclusion, steps 816 and829 work together to display available pictures for a preset, useradjustable period of time. Any text information displays are similarlyclocked by means of steps 821 and 835. Unless the user intervenes,located information is heard for its duration, read and seen for aperiod of time. Once such information plays are over without the usertaking action, Show/Tell All proceeds to present multimedia on the nextPOI. Available at any point in any Show/Tell All output operation, step819,866 provides the user with slide controls of the rewind, stop andfast-forward type, revealed in more detail in FIG. 8D. Step 819,866 letsusers discretely replay, extend or advance audio, visual and textoutputs together or as individual media. The user can concentrate on,repeat or skip over particular information at will, electing a certainmedium or combination of media as well.

This capability aids the user to interact with or respond to themultimedia information, for example: (1) to make decisions about whichPOIs or locations to include or delete as waypoint inputs; or (2) topick, edit and compose location-related information for attachment tocombined travel plan output. Likewise, step 827 stops the clock orblocks expiration of text information outputs or displays whenever theuser opts to engage in manipulation or adjustment of the multimediaoutput/display. This means that the map display and related textinformation window remain in place focusing on the current POI while theuser engages in activities such as resetting the time period for text orvisual displays, or resizing or repositioning text or picture windowscovering part or all of the map display, or modification of waypointlists or the attachment of information to travel plans.

In FIG. 8B,8C steps 831 and 833, 837 and 839, 851 and 853 do essentiallythe same job for audio, text and visual presentations. These stepsincrement the POI pointer to the next POI left on the current POI listonce a specific presentation is finished or terminated by the user. Theuser then returns to F1 in FIG. 8A to get the next POI, and recenter themap display if needed.

Presentations about the final POI on the current list are complete asdetermined in steps 831,853 and 839 respectively for audio, text andpictures. Then the locator arrows for current POIs, see step 810, andother symbols or legends placed on the map display as part of anymultimedia presentation, are erased or cleaned up in steps 841,855 and846. Then, steps 849, 848 and 863 return the user to the POI Listbox ormain multimedia menu, as detailed relative to FIG. 3.

In the manner of a modal dialog box, at the end of a text and picturedisplay, step 857 holds text and pictures on screen while asking theuser "Are you done?" in effect. The user then can opt to select ordelete the pertinent POI or the nearest node as a waypoint, or to editand attach multimedia information about the POI to an emerging travelplan. Or if the user hits the 859 OK button, then the text display isremoved in step 861, and the process returns to restart the picturedisplay clock at step 816. Unless the user opts for a replay of the textoption at 823, steps 829 times out the picture. If there still are morePOIs on a Show/Tell All list, steps 839 and 837 return the user toconnector F1 in FIG. 8A to get the next POI on the current list. At theend of the current POI list, as detected in step 839, step 846 cleans upthe map display. At 848, operations are returned to the POI listbox thatis detailed further relative to FIG. 3 and FIG. 1J at 148.

FIG. 8D details the working of the "stop", "rewind", and "fastforward"style Slide Control shown at 718 in FIG. 7 and 819 and 866 in FIG. 8. Atconnector F3, the user is presented on the system interface withoptional buttons to replay, halt or advance multimedia presentations. At874 and 878, the forward and back arrow buttons effectively increment ordecrement the POI pointer. Steps 880 and 882 reset the presentation onthe beginning of the current list whenever the user backs up past thefirst item on a given POI list. Thus, full back and forward operationsmove the user to F2, which is the beginning of Show/Tell operationsshown also in FIG. 8B. The Stop button brings multimedia operations to ahalt at 872, cleaning up any text or pictures presented in windows ontop of the map display in 876. The Stop button takes the user back tothe POI listbox which is the startup multimedia mode described inrelation to FIG. 3.

While the invention has been described with reference to particularexample embodiments it is intended to cover all modifications andequivalents within the scope of the following claims.

We claim:
 1. A computer aided routing system (CARS) comprising:a digitalcomputer having a computer display; a map database providing a set ofelectronic maps for presentation on the computer display; saidelectronic maps depicting transportation routes having identifiedwaypoints including route intersections at geographical locations alongthe transportation routes, said identified waypoints depicted on theelectronic maps being identified in the computer by coordinate locationsof a selected geographical coordinate system; a CARS database ofgeographically locatable points of interest (POIs) identified bycoordinate locations in said geographical coordinate system, said POIsbeing organized into a plurality of types for user selection of POIs bytype, said POI types comprising overlays of the CARS database fordisplay over the electronic maps on the computer display; CARS softwareconstructed for user travel planning using said electronic mapspresented on the computer display, said CARS software permitting userselection of a travel origin, travel destination, and desired waypointsbetween the travel origin and travel destination, said CARS softwarecalculating, delineating, and displaying a travel route between thetravel origin and travel destination via the selected waypointsaccording to user choice of the shortest travel route, quickest travelroute, or user selected preferred travel route; said CARS softwarepermitting user selection of a region of interest along the user definedtravel route, said region of interest having user specified dimensionsand permitting user selection of specified POI types within said regionof interest and user selection of particular POIs from the selectedtypes within the region of interest, said region of interest beingidentified in the computer by coordinate locations of said geographicalcoordinate system; said CARS database comprising travel informationselected from the group consisting of graphics, photos, videos,animations, audio information, and text information about POIs of theCARS database and about selected transportation routes and waypoints ofthe electronic maps; said CARS software being constructed to present auser customized travelog for preview on the computer display of the userdefined travel route including said travel information in the CARSdatabase on the transportation routes and waypoints of the electronicmaps and the selected POIs of the CARS database in the user definedregion of interest along the travel route.
 2. The CARS of claim 1wherein the CARS software is constructed to display a user customizedstrip map of the user defined travel route.
 3. The CARS of claim 2wherein the CARS software is constructed to display a user customizedstrip map of the user defined travel route along the center of thecomputer display, user selected POIs in the user defined region ofinterest being listed along one side of the strip map with pointers torespective POI locations in the region, and travel directions for thetravel route being listed along the other side of the strip map withpointers to respective intersections corresponding to directions alongthe travel route.
 4. The CARS of claim 3 wherein the user customizedstrip map is vertically oriented with the travel origin at the bottom ofthe strip map and travel destination toward the top of the strip map. 5.The CARS of claim 2 wherein the digital computer comprises a printer andwherein the CARS software is constructed for printing hardcopy maps ofthe user customized strip maps.
 6. The CARS of claim 3 wherein thedigital computer comprises a printer and wherein the CARS software isconstructed for printing hardcopy maps of the user customized strip mapsshowing the travel route, list of POIs and pointers along one side ofthe strip map, and list of directions and pointers along the other sideof the strip map.
 7. The CARS of claim 1 wherein the electronic maps,CARS database, and CARS software are stored on a CDROM and the digitalcomputer comprises a CDROM drive.
 8. The CARS of claim 7 wherein theCARS software comprises a replace function for updating the electronicmaps and CARS database on the CDROM with replacement or supplementalinformation from another memory device.
 9. The CARS of claim 1 whereinthe transportation routes depicted on the electronic maps are selectedfrom the group consisting of vehicle routes, ferry routes, air travelroutes, bicycle routes, and hiking trails.
 10. The CARS of claim 1wherein the selected geographical coordinate system is the standardlatitude/longitude (lat/long) geographical coordinate system andcoordinate locations are stored in the digital computer as lat/longcoordinates.
 11. The CARS of claim 1 wherein said CARS software isconstructed to permit initial user browsing of the CARS database travelinformation to assist user selection of an initial travel route.
 12. TheCARS of claim 1 wherein the CARS software is constructed forincorporating POIs selected by the user in the region of interest aswaypoints in the user defined travel route, said CARS software alsobeing constructed for recalculating, delineating, and displaying a newuser defined travel route via the selected POIs as waypoints.
 13. TheCARS of claim 12 wherein the waypoints of the electronic maps compriseinformation including the transportation routes entering and leaving therespective nodes.
 14. The CARS of claim 1 wherein the POI types areselected from the group consisting of restaurants, hotels/motels,cities, municipalities, settlements, routes, transportation servicessuch as airports, ferries, and railroads, parks, recreation areas,campgrounds, hospitals, zoos, museums, tourist and sightseeingattractions, and other geographical landmarks.
 15. The CARS of claim 1wherein the travelog for preview on the computer display of the userdefined travel route is a multimedia travelog.
 16. The CARS of claim 1wherein the waypoints are named locations on the electronic maps. 17.The CARS of claim 2 wherein the CARS software is constructed so that POItypes and particular POIs of the first database selected by the user aredisplayed as overlays on the electronic maps and the user customizedstrip maps.
 18. The CARS of claim 1 comprising a set of printed mapssubstantially coinciding with the set of electronic maps for user crossreference, correlation, and coordination between the computer displaypresented electronic maps and said printed maps.
 19. The CARS of claim 3comprising a set of printed maps substantially coinciding with the setof electronic maps for user cross reference, correlation, andcoordination between the computer display presentation of user definedstrip maps and said printed maps.
 20. The CARS of claim 18 comprising agrid system of grid lines overlaying the electronic maps and the printedmaps, said grid lines defining uniquely named grid quadrangles, saiduniquely named grid quadrangles of the electronic maps and printed mapssubstantially coinciding in geographic areas depicted by the gridquadrangles to facilitate cross reference, correlation and coordinationbetween the computer display map presentations and the correspondingprinted maps.
 21. The CARS of claim 20 wherein the electronic maps andprinted maps comprise substantially constant scale maps.
 22. The CARS ofclaim 21 comprising electronic maps at a plurality of scales, said mapsat each scale being substantially constant scale maps, said grid systemcomprising a plurality of sets of grid lines corresponding to therespective scales and defining uniquely named grid quadrangles at eachscale.
 23. The CARS of claim 22 wherein the CARS software is constructedto permit user scrolling across grid quadrangles at the same scale andto permit zooming between grid quadrangles at different scales, and fordisplaying said scrolling and zooming steps on the computer display. 24.The CARS of claim 1 wherein the CARS software is constructed forincorporating POIs selected by the user in a corridor of specified widthalong the travel route as waypoints in the user defined travel route,said CARS software also being constructed for recalculating,delineating, and displaying a new user defined travel route via theselected POIs as waypoints.
 25. The CARS of claim 1 wherein the digitalcomputer is selected from the group consisting of PDA's, notebooks,portable computers, desktop computers, workstations, and mainframes. 26.The CARS of claim 1 wherein the CARS software is constructed so that theuser can browse through the CARS database of travel information and canchange the user selected travel origin, travel destination,transportation routes, and intermediate waypoints, said CARS softwarerecalculating, delineating, and displaying on the computer display arevised travel route.
 27. The CARS of claim 26 wherein the CARS softwareis constructed for reassembling a revised user customized travelog forpreviewing the user defined revised travel route.
 28. The CARS of claim1 wherein the CARS software comprises a routing subsystem, a multimediasubsystem, and an interactive mode for interaction between the twosubsystems.
 29. The CARS of claim 28 wherein the routing subsystemperforms travel planning and routing functions, calculating anddisplaying a route according to user choices and constraints, andwherein the multimedia subsystem performs multimedia functions,retrieving and displaying multimedia information about selected POI's,and wherein during the interactive mode, the multimedia subsystemconstructs a travelog following the user defined route calculated by therouting subsystem.
 30. A computer aided routing system (CARS)comprising:a digital computer having a computer display; a map databaseproviding a set of electronic maps for presentation on the computerdisplay; said electronic maps depicting transportation routes havingidentified waypoints including route intersections at geographicallocations along the transportation routes, said identified waypointsdepicted on the electronic maps being identified in the computer bycoordinate locations of a selected geographical coordinate system; aCARS database of geographically locatable points of interest (POIs)identified by coordinate locations in said geographical coordinatesystem, said POIs being organized into a plurality of types for userselection of POIs by type, said POI types comprising overlays of theCARS database for display over the electronic maps on the computerdisplay; CARS software constructed for user travel planning using saidelectronic maps presented on the computer display, said CARS softwarepermitting user selection of a travel origin, travel destination, anddesired waypoints between the travel origin and travel destination, saidCARS software calculating, delineating, and displaying a travel routebetween the travel origin and travel destination via the selectedwaypoints according to user choice of the shortest travel route,quickest travel route, or user selected preferred travel route; saidCARS software permitting user selection of a region of interest alongthe user defined travel route, said region of interest having userspecified dimensions and permitting user selection of specified POItypes within said region and user selection of particular POIs from aselected type within the region of interest, said region of interestbeing identified in the computer by coordinate locations of saidgeographical coordinate system; said CARS database comprising travelinformation selected from the group consisting of graphics, photos,videos, animations, audio information, and text information about POIsof the CARS database and about waypoints of the electronic maps; saidCARS software being constructed to present a user customized travelogfor preview on the computer display of the user defined travel routeincluding said travel information in the CARS database on the waypointsof the electronic maps and the selected POIs of the CARS database in theuser defined region of interest along the travel route; said CARSsoftware being constructed to display a user customized strip map of theuser defined travel route along the center of the screen, user selectedPOIs in the user defined region of interest being listed along one sideof the strip map with pointers to respective POI locations in a corridorof specified width along the travel route, and travel directions alongthe travel route being listed along the other side of the strip map withpointers to respective intersections corresponding to directions alongthe travel route; said user customized strip map being verticallyoriented with the travel origin at the bottom of the strip map andtravel destination toward the top of the strip map.
 31. The CARS ofclaim 30 wherein the CARS software is constructed to permit initial userbrowsing of the CARS database travel information to assist userselection of an initial travel route.
 32. The CARS of claim 30comprising a set of printed maps substantially coinciding with the setof electronic maps for user cross reference, correlation, andcoordination between the computer display presented electronic maps andsaid printed maps and between the computer display presentation of userdefined strip maps and said printed maps;a grid system of grid linesoverlaying the electronic maps and the printed maps, said grid linesdefining uniquely named grid quadrangles, said uniquely named gridquadrangles of the electronic maps and printed maps substantiallycoinciding in geographic areas depicted by the grid quadrangles tofacilitate cross reference, correlation and coordination between thecomputer display map presentations and the corresponding printed maps;said electronic maps and printed maps comprising substantially constantscale maps.
 33. The CARS of claim 32 comprising electronic maps at aplurality of scales, said maps at each scale being substantiallyconstant scale maps, said grid system comprising a plurality of sets ofgrid lines corresponding to the respective scales and defining uniquelynamed grid quadrangles at each scale.
 34. The CARS of claim 30 whereinsaid CARS software comprises a replace function for updating theelectronic maps and first database with replacement or supplementalinformation from another memory device.
 35. The CARS of claim 31 whereinthe CARS software is constructed for incorporating POIs selected by theuser in the region of interest as waypoints in the user defined travelroute, said CARS software also being constructed for recalculating,delineating, and displaying a new user defined travel route via theselected POIs as waypoints.
 36. The CARS of claim 30 wherein the CARSsoftware comprises a routing subsystem, a multimedia subsystem, and aninteractive mode for interaction between the two subsystems.
 37. TheCARS of claim 30 wherein the routing subsystem performs travel planningand routing functions, calculating and displaying a route according touser choices and constraints, and wherein the multimedia subsystemperforms multimedia functions, retrieving and displaying multimediainformation about selected POI's, and wherein during the interactivemode, the multimedia subsystem constructs a travelog following the userdefined route calculated by the routing subsystem.
 38. A computer aidedrouting method (CARM) using a digital computer with computer display, amap database providing electronic maps having transportation routes,route intersections and identified waypoints along the transportationroutes for presentation on the computer display, and a computer aidedrouting system (CARS) software constructed for user travel planning,comprising:presenting the electronic maps on the computer display;selecting on the electronic maps a user travel origin, traveldestination, and intermediate waypoints at geographical locationsbetween the travel origin and travel destination; calculating,delineating, and displaying on the computer display a travel routebetween the user travel origin and travel destination via the userselected waypoints according to user choice of the shortest travelroute, quickest travel route, or user selected preferred travel route;selecting a region of interest to the user along the user defined travelroute, said region having user defined dimensions limiting excursions oneither side of the user defined travel route; providing a CARS databaseof geographically locatable points of interest (POIs) in thegeographical areas of the electronic maps, said POIs being organizedinto a plurality of type for user selection of POIs by type, said POItypes comprising overlays of the CARS database for display over theelectronic maps on the computer display, said CARS database alsocomprising travel information selected from the group consisting ofgraphics, photos, videos, animations, audio information and textinformation about transportation routes and waypoints of the electronicmaps and POIs of the CARS database; identifying in the digital computerthe transportation routes, route intersections, and waypoints of theelectronic maps, region of interest selected by the user, and theselected POIs of the CARS database, by coordinate locations in a commongeographical coordinate system; selecting specified POI types in theuser defined region of interest along the user defined travel route andselecting particular POIs from the selected types in the region;assembling and displaying on the computer display a user customizedtravelog for preview of the user defined travel route, said travelogincluding travel information in the CARS database on the transportationroutes and waypoints of the electronic maps and selected POIs in theuser defined region of interest along the user defined travel route. 39.The CARM of claim 38 comprising the step of assembling and displaying onthe computer display a user customized strip map of the user definedtravel route.
 40. The CARM of 39 comprising the step of displaying theuser customized strip map along the center of the computer display,displaying a list of user selected POIs in the user defined region ofinterest along one side of the user customized strip map with pointerspointing to respective POI locations in the corridor, and displayingtravel directions along the travel route along the other side of thestrip map with pointers pointing to respective intersectionscorresponding to directions along the travel route.
 41. The CARM ofclaim 40 comprising the step of displaying the user customized strip mapin a vertical orientation with the travel origin at the bottom of thestrip map and travel destination toward the top of the strip map. 42.The CARM of claim 41 comprising the step of printing a hardcopy map ofthe user customized strip map showing the user defined travel route,list of user selected POIs in the region of interest and respectivepointers along one side of the strip map, and the list of directions andrespective pointers on the other side of the strip map.
 43. The CARM ofclaim 38 wherein the electronic maps, CARS database, and CARS softwareare stored on a CDROM and the digital computer comprises a CDROM driveand further comprising the step of updating the electronic maps and CARSdatabase with replacement or supplemental information from anothermemory device using a replace function of the routing software.
 44. TheCARM of claim 38 wherein the transportation routes depicted on theelectronic maps are selected from the group consisting of vehicleroutes, ferry routes, air travel routes, bicycle routes and hikingtrails.
 45. The CARM of claim 38 wherein the selected geographicalcoordinate system is the standard latitude/longitude (lat/long)geographical coordinate system and comprising the step of storinggeographical coordinates in the digital computer as lat/longcoordinates.
 46. The CARM of claim 38 comprising the step of initialuser browsing of the CARS database travel information for assistance inselecting an initial route.
 47. The CARM of claim 38 comprising thesteps of incorporating POIs selected by the user in the region ofinterest as waypoints in the user defined travel route, andrecalculating, delineating, and displaying a new user defined travelroute via the selected POIs as waypoints.
 48. The CARM of claim 38wherein the POI types of the first database comprise restaurants,hotels/motels, cities, municipalities, settlements, routes,transportation services such as airports, ferries, and railroads, parks,recreation areas, campgrounds, hospitals, zoos, museums, tourist andsightseeing attractions, and other geographical landmarks.
 49. The CARMof claim 38 wherein the step of assembling and displaying a usercustomized travelog comprises assembling and displaying a multimediatravelog.
 50. The CARM of claim 38 comprising the step of displaying theuser selected POIs of the CARS database as at least one overlay on theelectronic maps.
 51. The CARM of claim 38 comprising the steps ofproviding a set of printed maps substantially coinciding with the set ofelectronic maps for user cross reference, correlation, and coordinationbetween the computer display presented electronic maps and said printedmaps; andproviding a grid system of grid lines overlaying the electronicmaps and the printed maps, said grid lines defining uniquely named gridquadrangles, said uniquely named grid quadrangles of the electronic mapsand printed maps substantially coinciding in geographic areas depictedby the grid quadrangles to facilitate cross reference, correlation andcoordination between the computer display map presentations and thecorresponding printed maps.
 52. The CARM of claim 51 comprising thesteps of providing electronic maps at a plurality of scales, said mapsat each scale being substantially constant scale maps, said grid systemcomprising a plurality of sets of grid lines corresponding to therespective scales and defining uniquely named grid quadrangles at eachscale; andscrolling across grid quadrangles at the same scale andzooming between quadrangles at different scales, and displaying thescrolling and zooming steps on the computer display.
 53. The CARM ofclaim 38 comprising the steps of incorporating POIs selected by the userin the corridor as waypoints in the user defined travel route, andrecalculating, delineating, and displaying a new user defined travelroute via the selected POIs as waypoints.
 54. The CARM of claim 53comprising the steps of assembling and displaying on the computerdisplay a new user customized travelog for previewing the new userdefined travel route via the selected POIs.
 55. The CARM of claim 38comprising the steps of changing the user selected travel origin, traveldestination, transportation routes, or intermediate waypoints,recalculating, delineating, and displaying on the computer display arevised travel route, and assembling and displaying on the computerdisplay a revised user customized travelog for previewing the revisedtravel route.
 56. The CARM of claim 55 comprising repeating the steps ofclaim 55 in an iterative process until the user arrives at asatisfactory user defined travel route.
 57. A user customized multimediatravelog constructed according to the method of claim
 38. 58. A usercustomized travelog assembled by the method of claim
 53. 59. A programstorage device readable by a machine, tangibly embodying a program ofinstruction executable by the machine to perform method steps forcomputer aided routing comprising:presenting electronic maps on acomputer display; selecting on the electronic maps a user travel origin,travel destination, and intermediate waypoints at geographical locationsbetween the travel origin and travel destination; calculating,delineating, and displaying on the computer display a travel routebetween the user travel origin and travel destination via the userselected waypoints according to user choice of the shortest travelroute, quickest travel route, or user selected preferred travel route;selecting a region of interest to the user along the user defined travelroute, said region having user defined dimensions limiting excursions oneither side of the user defined travel route; providing a computer aidedrouting system (CARS) database of geographically locatable points ofinterest (POIs) in the geographical areas of the electronic maps, saidPOIs being organized into a plurality of type for user selection of POIsby type, said POI types comprising overlays of the CARS database fordisplay over the electronic maps on the computer display, said CARSdatabase also comprising travel information selected from the groupconsisting of graphics, photos, videos, animations, audio informationand text information about transportation routes and waypoints of theelectronic maps and POIs of the CARS database; identifying in thedigital computer the transportation routes, route intersections, andwaypoints of the electronic maps, region of interest selected by theuser, and the selected POIs of the CARS database, by coordinatelocations in a common geographical coordinate system; selectingspecified POI types in the user defined region of interest along theuser defined travel route and selecting particular POIs from theselected types in the region; assembling and displaying on the computerdisplay a user customized travelog for preview of the user definedtravel route, said travelog including travel information in the CARSdatabase on the transportation routes and waypoints of the electronicmaps and selected POIs in the user defined region of interest along theuser defined travel route.